2024-04-16T12:44:30.300 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T12:44:30.300 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi --verbose --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129 --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/orig.config.yaml 2024-04-16T12:44:30.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T12:44:30.428 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129 branch: wip-lusov-shared-log-segment description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} email: null first_in_suite: false job_id: '7658129' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMEVUKDqZzMfUSudXchvN2uYeGidekfIFWKsXHu/gZLhfwu8TUbiUkyD0uhXn/7Cg0L0ImEityTn4xHbacMWAo= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx6p853EcotvH90NVoZD9xtnANTx3LRiJtJMb924TOc8C3Sl4x/u8/L59YbBM/3i8CQ3PwcphraGV8X+DY+2Kc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_fs teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T12:44:30.428 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T12:44:30.429 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T12:44:30.429 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T12:44:30.430 INFO:teuthology.task.internal:Checking packages... 2024-04-16T12:44:30.451 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T12:44:30.452 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T12:44:30.452 INFO:teuthology.packaging:ref: None 2024-04-16T12:44:30.452 INFO:teuthology.packaging:tag: None 2024-04-16T12:44:30.452 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T12:44:30.452 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:44:30.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T12:44:30.675 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T12:44:30.676 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T12:44:30.682 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T12:44:30.682 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T12:44:30.695 INFO:teuthology.task.internal:Saving configuration 2024-04-16T12:44:30.711 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T12:44:30.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:44:30.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:41.088616', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMEVUKDqZzMfUSudXchvN2uYeGidekfIFWKsXHu/gZLhfwu8TUbiUkyD0uhXn/7Cg0L0ImEityTn4xHbacMWAo='} 2024-04-16T12:44:30.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:41.087254', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx6p853EcotvH90NVoZD9xtnANTx3LRiJtJMb924TOc8C3Sl4x/u8/L59YbBM/3i8CQ3PwcphraGV8X+DY+2Kc='} 2024-04-16T12:44:30.756 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T12:44:30.791 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-16T12:44:30.791 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-16T12:44:30.791 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T12:44:30.865 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f083ee1b160>, signals=[15]) 2024-04-16T12:44:30.865 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T12:44:30.871 INFO:teuthology.task.internal:Opening connections... 2024-04-16T12:44:30.871 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:44:30.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:44:30.979 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:44:30.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:44:31.064 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T12:44:31.070 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-04-16T12:44:31.087 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-04-16T12:44:31.087 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-04-16T12:44:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:44:31.144 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:44:31.144 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:44:31.144 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:44:31.144 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:44:31.144 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:44:31.144 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-16T12:44:31.166 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-16T12:44:31.183 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-16T12:44:31.183 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:44:31.240 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:44:31.241 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:44:31.241 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-16T12:44:31.258 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T12:44:31.267 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T12:44:31.271 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T12:44:31.271 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:44:31.273 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:44:31.297 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T12:44:31.302 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T12:44:31.302 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:44:31.330 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:44:31.360 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T12:44:31.405 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T12:44:31.419 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-16T12:44:31.419 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-16T12:44:31.419 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-16T12:44:31.419 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:44:31.420 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:44:31.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:44:31.436 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-16T12:44:31.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:44:31.437 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-16T12:44:31.492 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:44:31.493 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-361.el9.x86_64 2024-04-16T12:44:31.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-04-16T12:44:31.496 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:44:31.496 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-361.el9.x86_64 2024-04-16T12:44:31.496 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-04-16T12:44:33.552 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-04-16T12:44:33.638 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-04-16T12:44:35.081 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-04-16T12:44:35.211 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-04-16T12:44:36.022 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-16T12:44:36.110 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T12:44:39.489 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-04-16T12:44:39.761 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-04-16T12:44:43.622 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-16T12:44:44.144 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-04-16T12:44:45.190 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-04-16T12:44:47.003 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 9.4 kB/s | 16 kB 00:01 2024-04-16T12:44:52.465 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 21 MB 00:07 2024-04-16T12:44:55.464 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 21 MB 00:08 2024-04-16T12:44:57.690 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-16T12:45:00.172 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T12:45:00.172 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T12:45:00.267 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T12:45:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-04-16T12:45:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:00.280 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 77 M 2024-04-16T12:45:00.280 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 123 M 2024-04-16T12:45:00.280 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-04-16T12:45:00.486 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-16T12:45:00.575 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 940 kB/s | 277 kB 00:00 2024-04-16T12:45:01.433 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 13 MB/s | 15 MB 00:01 2024-04-16T12:45:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 20 MB/s | 28 MB 00:01 2024-04-16T12:45:02.325 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 16 MB/s | 34 MB 00:02 2024-04-16T12:45:02.328 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:45:02.329 INFO:teuthology.orchestra.run.smithi018.stdout:Total 37 MB/s | 77 MB 00:02 2024-04-16T12:45:02.329 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-04-16T12:45:02.773 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-04-16T12:45:02.773 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-04-16T12:45:02.876 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T12:45:02.876 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T12:45:02.995 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-16T12:45:03.002 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-04-16T12:45:03.003 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:03.004 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 77 M 2024-04-16T12:45:03.004 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 123 M 2024-04-16T12:45:03.004 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-16T12:45:03.229 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.2 MB/s | 277 kB 00:00 2024-04-16T12:45:03.613 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-04-16T12:45:03.613 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-04-16T12:45:04.270 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 12 MB/s | 15 MB 00:01 2024-04-16T12:45:05.295 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-04-16T12:45:05.612 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 12 MB/s | 28 MB 00:02 2024-04-16T12:45:05.615 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:45:05.616 INFO:teuthology.orchestra.run.smithi104.stdout:Total 29 MB/s | 77 MB 00:02 2024-04-16T12:45:05.616 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-16T12:45:05.991 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-16T12:45:05.991 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-16T12:45:06.046 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-04-16T12:45:06.670 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:45:06.768 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:06.871 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-16T12:45:06.872 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-16T12:45:09.220 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-16T12:45:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:09.755 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:09.827 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:45:09.920 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:12.663 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:12.795 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:14.935 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:14.979 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:17.504 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:17.744 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:20.081 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:22.462 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:50.768 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:50.769 INFO:teuthology.orchestra.run.smithi018.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:45:50.769 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:50.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:45:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:51.590 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:51.591 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-04-16T12:45:51.909 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:45:52.015 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.016 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:45:52.016 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T12:45:52.016 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T12:45:52.016 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T12:45:52.016 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-16T12:45:52.016 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T12:45:52.016 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:45:52.017 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:52.017 INFO:teuthology.orchestra.run.smithi104.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:45:52.018 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:52.062 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:52.099 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.100 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:45:52.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-04-16T12:45:52.137 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-04-16T12:45:52.137 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-04-16T12:45:52.137 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 68.el9 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8264254 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:45:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:45:52.139 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:45:52.140 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:45:52.140 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-438.el9.x86_64 2024-04-16T12:45:52.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:45:52.479 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:52.479 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T12:45:52.479 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T12:45:52.479 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T12:45:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-04-16T12:45:52.926 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T12:45:52.926 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:52.926 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:52.927 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-16T12:45:53.252 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:45:53.356 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:53.356 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:45:53.356 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T12:45:53.356 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T12:45:53.357 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T12:45:53.357 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-16T12:45:53.357 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T12:45:53.357 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T12:45:53.436 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T12:45:53.436 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T12:45:53.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 68.el9 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8264254 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:45:53.476 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:45:53.477 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:45:53.478 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:45:53.478 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-438.el9.x86_64 2024-04-16T12:45:53.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:45:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:45:54.129 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-04-16T12:45:54.131 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-16T12:45:54.145 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-04-16T12:45:54.146 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.GM8A6QxGmi 2024-04-16T12:45:54.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GM8A6QxGmi 2024-04-16T12:45:54.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.GM8A6QxGmi 2024-04-16T12:45:54.371 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.GM8A6QxGmi is 6KB 2024-04-16T12:45:54.391 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.GM8A6QxGmi 2024-04-16T12:45:54.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:45:54.481 INFO:teuthology.orchestra.run.smithi018.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:45:54.482 INFO:teuthology.orchestra.run.smithi018.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:45:54.482 INFO:teuthology.orchestra.run.smithi018.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:45:54.482 INFO:teuthology.orchestra.run.smithi018.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T12:45:54.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T12:45:54.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-04-16T12:45:55.645 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:45:55.680 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-04-16T12:45:55.681 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-16T12:45:55.696 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.sNgC3WAvNr 2024-04-16T12:45:55.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sNgC3WAvNr 2024-04-16T12:45:55.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.sNgC3WAvNr 2024-04-16T12:45:55.905 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.sNgC3WAvNr is 6KB 2024-04-16T12:45:55.924 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.sNgC3WAvNr 2024-04-16T12:45:55.938 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:45:56.003 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:45:56.003 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:45:56.003 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:45:56.004 INFO:teuthology.orchestra.run.smithi104.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T12:45:56.005 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T12:45:56.165 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-04-16T12:46:24.649 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-16T12:46:24.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-16T12:46:24.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:46:26.169 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-16T12:46:26.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-16T12:46:26.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:24.711 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T12:47:26.173 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T12:47:33.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-16T12:47:33.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:34.007 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-16T12:47:34.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-16T12:47:34.432 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-438.el9.x86_64"... 2024-04-16T12:47:34.432 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-16T12:47:34.446 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-438.el9.x86_64 2024-04-16T12:47:34.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T12:47:34.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:47:34.447 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:47:35.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-16T12:47:35.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:35.447 DEBUG:teuthology.parallel:result is None 2024-04-16T12:47:36.825 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-16T12:47:37.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-16T12:47:37.303 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-438.el9.x86_64"... 2024-04-16T12:47:37.303 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-16T12:47:37.317 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-438.el9.x86_64 2024-04-16T12:47:37.317 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T12:47:37.317 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:47:37.318 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:47:38.318 DEBUG:teuthology.parallel:result is None 2024-04-16T12:47:38.319 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T12:47:38.326 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T12:47:38.327 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:47:38.329 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:47:38.346 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T12:47:38.352 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T12:47:38.362 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T12:47:38.363 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:47:38.382 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:47:38.424 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T12:47:38.430 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T12:47:38.431 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:47:38.444 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:47:38.503 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:47:38.559 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:47:38.568 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:47:38.617 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:47:38.618 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T12:47:38.626 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T12:47:38.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:47:38.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:47:38.658 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T12:47:38.668 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T12:47:38.668 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:47:38.695 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:47:38.713 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:47:38.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:47:38.875 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:47:38.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:47:38.983 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:47:38.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:47:39.028 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:47:39.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:47:39.123 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:47:39.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:47:39.249 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:47:39.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:47:39.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-04-16T12:47:39.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-04-16T12:47:39.404 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:47:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:47:39.793 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T12:47:39.801 INFO:teuthology.task.internal:Starting timer... 2024-04-16T12:47:39.801 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T12:47:39.818 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T12:47:39.826 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-16T12:47:39.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-04-16T12:47:39.909 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-04-16T12:47:39.911 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-04-16T12:47:39.955 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-04-16T12:47:39.957 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T12:47:39.957 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-04-16T12:47:39.978 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-04-16T12:47:39.979 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-04-16T12:47:40.013 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-04-16T12:47:40.013 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive'} 2024-04-16T12:47:40.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:47:40.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:47:40.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:47:40.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:47:40.082 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T12:47:40.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:47:40.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:47:40.178 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T12:47:40.187 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-16T12:47:40.224 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-16T12:47:40.348 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T12:47:40.364 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T12:47:40.365 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T12:52:13.809 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2024-04-16T12:52:13.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-16T12:52:13.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:52:13.953 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-16T12:52:14.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-16T12:52:14.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-16T12:52:14.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:52:14.306 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-16T12:52:14.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-16T12:52:14.386 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T12:52:14.415 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T12:52:14.415 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T12:52:14.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:52:14.468 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T12:52:14.476 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:52:14.501 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T12:52:14.502 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T12:52:14.507 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-04-16T12:52:14.526 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-04-16T12:52:14.537 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T12:52:14.540 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T12:52:14.556 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T12:52:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T12:52:14.588 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-04-16T12:52:14.603 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-04-16T12:52:14.619 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:52:14.627 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.628 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.643 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T12:52:14.692 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.696 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:52:14.696 INFO:teuthology.run_tasks:Running task install... 2024-04-16T12:52:14.706 DEBUG:teuthology.task.install:project ceph 2024-04-16T12:52:14.706 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T12:52:14.706 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T12:52:14.706 INFO:teuthology.task.install:Using flavor: default 2024-04-16T12:52:14.712 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T12:52:14.712 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T12:52:14.713 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T12:52:14.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:52:14.750 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T12:52:14.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:52:15.014 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T12:52:15.015 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T12:52:15.019 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T12:52:15.019 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T12:52:15.149 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T12:52:15.149 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:52:15.149 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T12:52:15.179 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T12:52:15.180 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T12:52:15.209 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T12:52:15.210 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:52:15.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T12:52:15.246 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T12:52:15.246 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T12:52:15.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T12:52:15.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T12:52:15.331 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T12:52:15.399 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-04-16T12:52:15.403 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-04-16T12:52:15.404 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T12:52:15.436 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-04-16T12:52:15.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-04-16T12:52:15.656 INFO:teuthology.orchestra.run.smithi104.stdout:74 files removed 2024-04-16T12:52:15.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T12:52:15.687 INFO:teuthology.orchestra.run.smithi018.stdout:74 files removed 2024-04-16T12:52:15.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T12:52:16.529 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 155 kB/s | 83 kB 00:00 2024-04-16T12:52:16.638 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 136 kB/s | 83 kB 00:00 2024-04-16T12:52:17.281 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-04-16T12:52:17.288 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-04-16T12:52:17.814 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-04-16T12:52:17.897 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-04-16T12:52:18.316 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-04-16T12:52:18.499 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-16T12:52:19.817 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-04-16T12:52:20.108 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-04-16T12:52:20.932 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-16T12:52:22.549 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.0 MB 00:02 2024-04-16T12:52:24.408 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-16T12:52:26.324 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 19 MB 00:04 2024-04-16T12:52:28.584 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-16T12:52:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-16T12:52:30.366 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-16T12:52:31.855 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-16T12:52:32.033 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-16T12:52:33.135 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-16T12:52:37.078 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-04-16T12:52:38.151 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-16T12:52:39.908 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:52:39.909 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:52:39.925 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T12:52:39.926 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T12:52:39.927 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T12:52:39.928 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T12:52:39.930 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T12:52:39.936 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T12:52:39.937 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T12:52:40.021 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-04-16T12:52:40.037 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-04-16T12:52:40.037 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T12:52:40.038 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T12:52:40.039 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T12:52:40.040 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T12:52:40.041 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T12:52:40.042 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T12:52:40.042 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T12:52:40.042 INFO:teuthology.orchestra.run.smithi018.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T12:52:40.042 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T12:52:40.051 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T12:52:40.051 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T12:52:40.051 INFO:teuthology.orchestra.run.smithi018.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T12:52:40.051 INFO:teuthology.orchestra.run.smithi018.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T12:52:40.051 INFO:teuthology.orchestra.run.smithi018.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T12:52:40.052 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-04-16T12:52:40.057 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T12:52:40.058 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T12:52:40.059 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T12:52:40.060 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T12:52:40.061 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T12:52:40.062 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T12:52:40.063 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T12:52:40.064 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T12:52:40.065 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T12:52:40.066 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T12:52:40.066 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T12:52:40.066 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T12:52:40.066 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T12:52:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T12:52:40.068 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T12:52:40.069 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================================ 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout:Install 150 Packages 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 24 Packages 2024-04-16T12:52:40.070 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:52:40.071 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 228 M 2024-04-16T12:52:40.071 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-04-16T12:52:40.902 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:52:40.903 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T12:52:40.915 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T12:52:40.916 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T12:52:40.917 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T12:52:40.918 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T12:52:40.920 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T12:52:40.923 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T12:52:40.924 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T12:52:41.006 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-04-16T12:52:41.018 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T12:52:41.019 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T12:52:41.020 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T12:52:41.021 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T12:52:41.022 INFO:teuthology.orchestra.run.smithi104.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T12:52:41.023 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T12:52:41.024 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T12:52:41.025 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T12:52:41.026 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T12:52:41.027 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T12:52:41.028 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T12:52:41.029 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T12:52:41.030 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T12:52:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================================ 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout:Install 150 Packages 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 24 Packages 2024-04-16T12:52:41.032 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:52:41.033 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 228 M 2024-04-16T12:52:41.033 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-04-16T12:52:41.395 INFO:teuthology.orchestra.run.smithi018.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-04-16T12:52:41.579 INFO:teuthology.orchestra.run.smithi018.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 4.8 MB/s | 890 kB 00:00 2024-04-16T12:52:41.629 INFO:teuthology.orchestra.run.smithi018.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 2.8 MB/s | 145 kB 00:00 2024-04-16T12:52:41.824 INFO:teuthology.orchestra.run.smithi018.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 13 MB/s | 2.4 MB 00:00 2024-04-16T12:52:41.955 INFO:teuthology.orchestra.run.smithi018.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-16T12:52:42.136 INFO:teuthology.orchestra.run.smithi104.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-04-16T12:52:42.323 INFO:teuthology.orchestra.run.smithi018.stdout:(6/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 13 MB/s | 4.7 MB 00:00 2024-04-16T12:52:42.936 INFO:teuthology.orchestra.run.smithi104.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-16T12:52:43.120 INFO:teuthology.orchestra.run.smithi104.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 827 kB/s | 145 kB 00:00 2024-04-16T12:52:43.561 INFO:teuthology.orchestra.run.smithi018.stdout:(7/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 14 MB/s | 17 MB 00:01 2024-04-16T12:52:43.989 INFO:teuthology.orchestra.run.smithi018.stdout:(8/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-04-16T12:52:44.097 INFO:teuthology.orchestra.run.smithi018.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 233 kB/s | 25 kB 00:00 2024-04-16T12:52:44.314 INFO:teuthology.orchestra.run.smithi018.stdout:(10/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 13 MB/s | 10 MB 00:00 2024-04-16T12:52:44.494 INFO:teuthology.orchestra.run.smithi104.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-04-16T12:52:44.514 INFO:teuthology.orchestra.run.smithi018.stdout:(11/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 6.4 MB/s | 21 MB 00:03 2024-04-16T12:52:44.539 INFO:teuthology.orchestra.run.smithi018.stdout:(12/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 1.0 MB/s | 225 kB 00:00 2024-04-16T12:52:44.598 INFO:teuthology.orchestra.run.smithi018.stdout:(13/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 325 kB/s | 27 kB 00:00 2024-04-16T12:52:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:(14/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 380 kB/s | 32 kB 00:00 2024-04-16T12:52:44.673 INFO:teuthology.orchestra.run.smithi018.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 3.2 MB/s | 163 kB 00:00 2024-04-16T12:52:44.824 INFO:teuthology.orchestra.run.smithi018.stdout:(16/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 3.2 MB/s | 746 kB 00:00 2024-04-16T12:52:44.849 INFO:teuthology.orchestra.run.smithi018.stdout:(17/174): librados-devel-19.0.0-2868.gc3c87ed0. 724 kB/s | 127 kB 00:00 2024-04-16T12:52:44.916 INFO:teuthology.orchestra.run.smithi018.stdout:(18/174): libradosstriper1-19.0.0-2868.gc3c87ed 5.3 MB/s | 500 kB 00:00 2024-04-16T12:52:44.969 INFO:teuthology.orchestra.run.smithi104.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-04-16T12:52:45.041 INFO:teuthology.orchestra.run.smithi018.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 361 kB/s | 45 kB 00:00 2024-04-16T12:52:45.053 INFO:teuthology.orchestra.run.smithi104.stdout:(6/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-04-16T12:52:45.167 INFO:teuthology.orchestra.run.smithi018.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 1.1 MB/s | 135 kB 00:00 2024-04-16T12:52:45.242 INFO:teuthology.orchestra.run.smithi018.stdout:(21/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 13 MB/s | 5.2 MB 00:00 2024-04-16T12:52:45.268 INFO:teuthology.orchestra.run.smithi018.stdout:(22/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.6 MB/s | 161 kB 00:00 2024-04-16T12:52:45.302 INFO:teuthology.orchestra.run.smithi018.stdout:(23/174): python3-rados-19.0.0-2868.gc3c87ed0.e 5.3 MB/s | 320 kB 00:00 2024-04-16T12:52:45.351 INFO:teuthology.orchestra.run.smithi018.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.9 MB/s | 99 kB 00:00 2024-04-16T12:52:45.393 INFO:teuthology.orchestra.run.smithi018.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 2.0 MB/s | 85 kB 00:00 2024-04-16T12:52:45.652 INFO:teuthology.orchestra.run.smithi018.stdout:(26/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 12 MB/s | 3.1 MB 00:00 2024-04-16T12:52:45.702 INFO:teuthology.orchestra.run.smithi018.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 3.3 MB/s | 170 kB 00:00 2024-04-16T12:52:45.752 INFO:teuthology.orchestra.run.smithi018.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 684 kB/s | 34 kB 00:00 2024-04-16T12:52:45.777 INFO:teuthology.orchestra.run.smithi018.stdout:(29/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 585 kB/s | 298 kB 00:00 2024-04-16T12:52:45.803 INFO:teuthology.orchestra.run.smithi018.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 2.8 MB/s | 142 kB 00:00 2024-04-16T12:52:46.537 INFO:teuthology.orchestra.run.smithi018.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-04-16T12:52:46.607 INFO:teuthology.orchestra.run.smithi018.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 4.3 MB/s | 3.5 MB 00:00 2024-04-16T12:52:46.634 INFO:teuthology.orchestra.run.smithi018.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2868.gc3 2.7 MB/s | 249 kB 00:00 2024-04-16T12:52:46.653 INFO:teuthology.orchestra.run.smithi018.stdout:(34/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 984 kB/s | 49 kB 00:00 2024-04-16T12:52:46.671 INFO:teuthology.orchestra.run.smithi018.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2868.gc 392 kB/s | 16 kB 00:00 2024-04-16T12:52:46.695 INFO:teuthology.orchestra.run.smithi104.stdout:(7/174): ceph-common-19.0.0-2868.gc3c87ed0.el9. 4.4 MB/s | 21 MB 00:04 2024-04-16T12:52:46.721 INFO:teuthology.orchestra.run.smithi018.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 3.8 MB/s | 264 kB 00:00 2024-04-16T12:52:46.754 INFO:teuthology.orchestra.run.smithi018.stdout:(37/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 8.9 MB/s | 762 kB 00:00 2024-04-16T12:52:46.770 INFO:teuthology.orchestra.run.smithi104.stdout:(8/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-04-16T12:52:46.781 INFO:teuthology.orchestra.run.smithi018.stdout:(38/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 312 kB/s | 18 kB 00:00 2024-04-16T12:52:46.820 INFO:teuthology.orchestra.run.smithi104.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 506 kB/s | 25 kB 00:00 2024-04-16T12:52:46.955 INFO:teuthology.orchestra.run.smithi018.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-04-16T12:52:46.991 INFO:teuthology.orchestra.run.smithi018.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 920 kB 00:00 2024-04-16T12:52:47.014 INFO:teuthology.orchestra.run.smithi018.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-04-16T12:52:47.039 INFO:teuthology.orchestra.run.smithi018.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-04-16T12:52:47.064 INFO:teuthology.orchestra.run.smithi018.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 635 kB/s | 32 kB 00:00 2024-04-16T12:52:47.165 INFO:teuthology.orchestra.run.smithi018.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-16T12:52:47.190 INFO:teuthology.orchestra.run.smithi018.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 138 kB/s | 17 kB 00:00 2024-04-16T12:52:47.215 INFO:teuthology.orchestra.run.smithi018.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 10 kB 00:00 2024-04-16T12:52:47.240 INFO:teuthology.orchestra.run.smithi018.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-16T12:52:47.266 INFO:teuthology.orchestra.run.smithi018.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 890 kB/s | 44 kB 00:00 2024-04-16T12:52:47.291 INFO:teuthology.orchestra.run.smithi018.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-16T12:52:47.317 INFO:teuthology.orchestra.run.smithi018.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-16T12:52:47.342 INFO:teuthology.orchestra.run.smithi018.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 941 kB/s | 46 kB 00:00 2024-04-16T12:52:47.367 INFO:teuthology.orchestra.run.smithi018.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-04-16T12:52:47.392 INFO:teuthology.orchestra.run.smithi018.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-04-16T12:52:47.417 INFO:teuthology.orchestra.run.smithi018.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-04-16T12:52:47.443 INFO:teuthology.orchestra.run.smithi018.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2024-04-16T12:52:47.560 INFO:teuthology.orchestra.run.smithi018.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-16T12:52:47.602 INFO:teuthology.orchestra.run.smithi018.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 9.8 MB/s | 1.5 MB 00:00 2024-04-16T12:52:47.629 INFO:teuthology.orchestra.run.smithi104.stdout:(10/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 11 MB/s | 10 MB 00:00 2024-04-16T12:52:47.644 INFO:teuthology.orchestra.run.smithi018.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 9.9 MB/s | 817 kB 00:00 2024-04-16T12:52:47.669 INFO:teuthology.orchestra.run.smithi018.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 132 kB 00:00 2024-04-16T12:52:47.721 INFO:teuthology.orchestra.run.smithi104.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 2.4 MB/s | 225 kB 00:00 2024-04-16T12:52:47.779 INFO:teuthology.orchestra.run.smithi104.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 466 kB/s | 27 kB 00:00 2024-04-16T12:52:47.803 INFO:teuthology.orchestra.run.smithi018.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-04-16T12:52:47.836 INFO:teuthology.orchestra.run.smithi018.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.2 MB/s | 1.0 MB 00:00 2024-04-16T12:52:47.837 INFO:teuthology.orchestra.run.smithi104.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 545 kB/s | 32 kB 00:00 2024-04-16T12:52:47.861 INFO:teuthology.orchestra.run.smithi018.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-16T12:52:47.971 INFO:teuthology.orchestra.run.smithi104.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 5.5 MB/s | 746 kB 00:00 2024-04-16T12:52:48.020 INFO:teuthology.orchestra.run.smithi018.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-04-16T12:52:48.039 INFO:teuthology.orchestra.run.smithi104.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 2.4 MB/s | 163 kB 00:00 2024-04-16T12:52:48.046 INFO:teuthology.orchestra.run.smithi018.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2024-04-16T12:52:48.070 INFO:teuthology.orchestra.run.smithi018.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-04-16T12:52:48.096 INFO:teuthology.orchestra.run.smithi018.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-16T12:52:48.105 INFO:teuthology.orchestra.run.smithi104.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.9 MB/s | 127 kB 00:00 2024-04-16T12:52:48.122 INFO:teuthology.orchestra.run.smithi018.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-04-16T12:52:48.198 INFO:teuthology.orchestra.run.smithi104.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 5.3 MB/s | 500 kB 00:00 2024-04-16T12:52:48.246 INFO:teuthology.orchestra.run.smithi018.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-04-16T12:52:48.271 INFO:teuthology.orchestra.run.smithi018.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-16T12:52:48.297 INFO:teuthology.orchestra.run.smithi018.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-04-16T12:52:48.325 INFO:teuthology.orchestra.run.smithi018.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-16T12:52:48.339 INFO:teuthology.orchestra.run.smithi018.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 987 kB/s | 41 kB 00:00 2024-04-16T12:52:48.365 INFO:teuthology.orchestra.run.smithi018.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-04-16T12:52:48.390 INFO:teuthology.orchestra.run.smithi018.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-04-16T12:52:48.415 INFO:teuthology.orchestra.run.smithi018.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-04-16T12:52:48.440 INFO:teuthology.orchestra.run.smithi018.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 954 kB/s | 47 kB 00:00 2024-04-16T12:52:48.466 INFO:teuthology.orchestra.run.smithi018.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2024-04-16T12:52:48.674 INFO:teuthology.orchestra.run.smithi018.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 187 kB/s | 39 kB 00:00 2024-04-16T12:52:48.739 INFO:teuthology.orchestra.run.smithi104.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 9.7 MB/s | 5.2 MB 00:00 2024-04-16T12:52:48.798 INFO:teuthology.orchestra.run.smithi104.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 779 kB/s | 45 kB 00:00 2024-04-16T12:52:48.874 INFO:teuthology.orchestra.run.smithi018.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-16T12:52:48.901 INFO:teuthology.orchestra.run.smithi018.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 184 kB/s | 41 kB 00:00 2024-04-16T12:52:48.925 INFO:teuthology.orchestra.run.smithi018.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-16T12:52:48.950 INFO:teuthology.orchestra.run.smithi018.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 701 kB/s | 35 kB 00:00 2024-04-16T12:52:48.976 INFO:teuthology.orchestra.run.smithi018.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 928 kB/s | 46 kB 00:00 2024-04-16T12:52:48.981 INFO:teuthology.orchestra.run.smithi104.stdout:(20/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x8 4.3 MB/s | 17 MB 00:03 2024-04-16T12:52:49.001 INFO:teuthology.orchestra.run.smithi018.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-04-16T12:52:49.007 INFO:teuthology.orchestra.run.smithi104.stdout:(21/174): python3-ceph-common-19.0.0-2868.gc3c8 646 kB/s | 135 kB 00:00 2024-04-16T12:52:49.026 INFO:teuthology.orchestra.run.smithi018.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-04-16T12:52:49.045 INFO:teuthology.orchestra.run.smithi104.stdout:(22/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 2.7 MB/s | 161 kB 00:00 2024-04-16T12:52:49.052 INFO:teuthology.orchestra.run.smithi018.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-16T12:52:49.078 INFO:teuthology.orchestra.run.smithi018.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-04-16T12:52:49.088 INFO:teuthology.orchestra.run.smithi104.stdout:(23/174): python3-rados-19.0.0-2868.gc3c87ed0.e 4.2 MB/s | 320 kB 00:00 2024-04-16T12:52:49.102 INFO:teuthology.orchestra.run.smithi018.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-04-16T12:52:49.127 INFO:teuthology.orchestra.run.smithi018.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-16T12:52:49.133 INFO:teuthology.orchestra.run.smithi104.stdout:(24/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 3.2 MB/s | 298 kB 00:00 2024-04-16T12:52:49.158 INFO:teuthology.orchestra.run.smithi104.stdout:(25/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.3 MB/s | 99 kB 00:00 2024-04-16T12:52:49.172 INFO:teuthology.orchestra.run.smithi018.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-04-16T12:52:49.183 INFO:teuthology.orchestra.run.smithi104.stdout:(26/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-16T12:52:49.190 INFO:teuthology.orchestra.run.smithi018.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-04-16T12:52:49.212 INFO:teuthology.orchestra.run.smithi018.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.9 MB/s | 124 kB 00:00 2024-04-16T12:52:49.238 INFO:teuthology.orchestra.run.smithi018.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-16T12:52:49.275 INFO:teuthology.orchestra.run.smithi104.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.8 MB/s | 170 kB 00:00 2024-04-16T12:52:49.342 INFO:teuthology.orchestra.run.smithi104.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 514 kB/s | 34 kB 00:00 2024-04-16T12:52:49.412 INFO:teuthology.orchestra.run.smithi018.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 938 kB/s | 187 kB 00:00 2024-04-16T12:52:49.426 INFO:teuthology.orchestra.run.smithi104.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.7 MB/s | 142 kB 00:00 2024-04-16T12:52:49.496 INFO:teuthology.orchestra.run.smithi018.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-16T12:52:49.521 INFO:teuthology.orchestra.run.smithi018.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-16T12:52:49.555 INFO:teuthology.orchestra.run.smithi018.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-16T12:52:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:(30/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 7.0 MB/s | 3.1 MB 00:00 2024-04-16T12:52:49.613 INFO:teuthology.orchestra.run.smithi018.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 234 kB/s | 21 kB 00:00 2024-04-16T12:52:49.638 INFO:teuthology.orchestra.run.smithi018.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-16T12:52:49.731 INFO:teuthology.orchestra.run.smithi018.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-04-16T12:52:49.781 INFO:teuthology.orchestra.run.smithi018.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-04-16T12:52:49.839 INFO:teuthology.orchestra.run.smithi018.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 18 MB/s | 4.1 MB 00:00 2024-04-16T12:52:49.864 INFO:teuthology.orchestra.run.smithi018.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-04-16T12:52:49.890 INFO:teuthology.orchestra.run.smithi018.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-16T12:52:49.998 INFO:teuthology.orchestra.run.smithi018.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 5.0 MB/s | 548 kB 00:00 2024-04-16T12:52:50.032 INFO:teuthology.orchestra.run.smithi018.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-04-16T12:52:50.065 INFO:teuthology.orchestra.run.smithi018.stdout:(107/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-04-16T12:52:50.083 INFO:teuthology.orchestra.run.smithi018.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-04-16T12:52:50.108 INFO:teuthology.orchestra.run.smithi018.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-04-16T12:52:50.133 INFO:teuthology.orchestra.run.smithi018.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-04-16T12:52:50.167 INFO:teuthology.orchestra.run.smithi018.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-04-16T12:52:50.200 INFO:teuthology.orchestra.run.smithi018.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-04-16T12:52:50.267 INFO:teuthology.orchestra.run.smithi018.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-16T12:52:50.301 INFO:teuthology.orchestra.run.smithi018.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 838 kB 00:00 2024-04-16T12:52:50.334 INFO:teuthology.orchestra.run.smithi018.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-04-16T12:52:50.360 INFO:teuthology.orchestra.run.smithi018.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-04-16T12:52:50.377 INFO:teuthology.orchestra.run.smithi018.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 768 kB/s | 32 kB 00:00 2024-04-16T12:52:50.394 INFO:teuthology.orchestra.run.smithi018.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 449 kB/s | 15 kB 00:00 2024-04-16T12:52:50.427 INFO:teuthology.orchestra.run.smithi018.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-04-16T12:52:50.452 INFO:teuthology.orchestra.run.smithi018.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-04-16T12:52:50.478 INFO:teuthology.orchestra.run.smithi018.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-04-16T12:52:50.503 INFO:teuthology.orchestra.run.smithi018.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 701 kB/s | 35 kB 00:00 2024-04-16T12:52:50.528 INFO:teuthology.orchestra.run.smithi018.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-04-16T12:52:50.579 INFO:teuthology.orchestra.run.smithi018.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-04-16T12:52:50.596 INFO:teuthology.orchestra.run.smithi018.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-16T12:52:50.621 INFO:teuthology.orchestra.run.smithi018.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-04-16T12:52:50.626 INFO:teuthology.orchestra.run.smithi104.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 2.9 MB/s | 3.5 MB 00:01 2024-04-16T12:52:50.646 INFO:teuthology.orchestra.run.smithi018.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-04-16T12:52:50.671 INFO:teuthology.orchestra.run.smithi018.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-16T12:52:50.697 INFO:teuthology.orchestra.run.smithi018.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-16T12:52:50.722 INFO:teuthology.orchestra.run.smithi018.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-04-16T12:52:50.755 INFO:teuthology.orchestra.run.smithi018.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-04-16T12:52:50.776 INFO:teuthology.orchestra.run.smithi104.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 1.6 MB/s | 249 kB 00:00 2024-04-16T12:52:50.798 INFO:teuthology.orchestra.run.smithi018.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 633 kB/s | 46 kB 00:00 2024-04-16T12:52:50.818 INFO:teuthology.orchestra.run.smithi104.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 1.2 MB/s | 49 kB 00:00 2024-04-16T12:52:50.822 INFO:teuthology.orchestra.run.smithi018.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-16T12:52:50.848 INFO:teuthology.orchestra.run.smithi018.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-16T12:52:50.873 INFO:teuthology.orchestra.run.smithi018.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-04-16T12:52:50.898 INFO:teuthology.orchestra.run.smithi018.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-04-16T12:52:50.910 INFO:teuthology.orchestra.run.smithi104.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 5.7 MB/s | 7.4 MB 00:01 2024-04-16T12:52:50.924 INFO:teuthology.orchestra.run.smithi018.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-16T12:52:50.938 INFO:teuthology.orchestra.run.smithi104.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2868.gc 141 kB/s | 16 kB 00:00 2024-04-16T12:52:50.949 INFO:teuthology.orchestra.run.smithi018.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-04-16T12:52:50.975 INFO:teuthology.orchestra.run.smithi018.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-04-16T12:52:51.002 INFO:teuthology.orchestra.run.smithi018.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-16T12:52:51.017 INFO:teuthology.orchestra.run.smithi018.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-04-16T12:52:51.027 INFO:teuthology.orchestra.run.smithi104.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 2.2 MB/s | 264 kB 00:00 2024-04-16T12:52:51.033 INFO:teuthology.orchestra.run.smithi018.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-04-16T12:52:51.051 INFO:teuthology.orchestra.run.smithi018.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-04-16T12:52:51.077 INFO:teuthology.orchestra.run.smithi018.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-04-16T12:52:51.101 INFO:teuthology.orchestra.run.smithi018.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-16T12:52:51.102 INFO:teuthology.orchestra.run.smithi104.stdout:(37/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 4.5 MB/s | 762 kB 00:00 2024-04-16T12:52:51.126 INFO:teuthology.orchestra.run.smithi018.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-16T12:52:51.129 INFO:teuthology.orchestra.run.smithi104.stdout:(38/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 182 kB/s | 18 kB 00:00 2024-04-16T12:52:51.143 INFO:teuthology.orchestra.run.smithi018.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-04-16T12:52:51.169 INFO:teuthology.orchestra.run.smithi018.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-04-16T12:52:51.210 INFO:teuthology.orchestra.run.smithi018.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-16T12:52:51.453 INFO:teuthology.orchestra.run.smithi104.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2024-04-16T12:52:51.487 INFO:teuthology.orchestra.run.smithi104.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 920 kB 00:00 2024-04-16T12:52:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-04-16T12:52:51.548 INFO:teuthology.orchestra.run.smithi104.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-04-16T12:52:51.563 INFO:teuthology.orchestra.run.smithi104.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 635 kB/s | 32 kB 00:00 2024-04-16T12:52:51.603 INFO:teuthology.orchestra.run.smithi018.stdout:(150/174): librados2-19.0.0-2868.gc3c87ed0.el9. 7.8 MB/s | 3.4 MB 00:00 2024-04-16T12:52:51.672 INFO:teuthology.orchestra.run.smithi104.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2024-04-16T12:52:51.722 INFO:teuthology.orchestra.run.smithi104.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-04-16T12:52:51.728 INFO:teuthology.orchestra.run.smithi018.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 18 MB/s | 2.3 MB 00:00 2024-04-16T12:52:51.739 INFO:teuthology.orchestra.run.smithi104.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 151 kB/s | 10 kB 00:00 2024-04-16T12:52:51.773 INFO:teuthology.orchestra.run.smithi104.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-16T12:52:51.790 INFO:teuthology.orchestra.run.smithi104.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-04-16T12:52:51.837 INFO:teuthology.orchestra.run.smithi018.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-04-16T12:52:51.848 INFO:teuthology.orchestra.run.smithi104.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-04-16T12:52:51.873 INFO:teuthology.orchestra.run.smithi104.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-04-16T12:52:51.887 INFO:teuthology.orchestra.run.smithi018.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 820 kB/s | 41 kB 00:00 2024-04-16T12:52:51.890 INFO:teuthology.orchestra.run.smithi104.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-04-16T12:52:51.931 INFO:teuthology.orchestra.run.smithi104.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-04-16T12:52:51.937 INFO:teuthology.orchestra.run.smithi018.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.8 MB/s | 248 kB 00:00 2024-04-16T12:52:51.950 INFO:teuthology.orchestra.run.smithi104.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-04-16T12:52:51.975 INFO:teuthology.orchestra.run.smithi104.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-04-16T12:52:51.996 INFO:teuthology.orchestra.run.smithi018.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-04-16T12:52:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 819 kB/s | 34 kB 00:00 2024-04-16T12:52:52.138 INFO:teuthology.orchestra.run.smithi018.stdout:(156/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-04-16T12:52:52.163 INFO:teuthology.orchestra.run.smithi018.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 427 kB/s | 71 kB 00:00 2024-04-16T12:52:52.200 INFO:teuthology.orchestra.run.smithi104.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-04-16T12:52:52.213 INFO:teuthology.orchestra.run.smithi018.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 484 kB/s | 36 kB 00:00 2024-04-16T12:52:52.243 INFO:teuthology.orchestra.run.smithi104.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 6.1 MB/s | 1.5 MB 00:00 2024-04-16T12:52:52.272 INFO:teuthology.orchestra.run.smithi018.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-04-16T12:52:52.285 INFO:teuthology.orchestra.run.smithi104.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 9.8 MB/s | 817 kB 00:00 2024-04-16T12:52:52.309 INFO:teuthology.orchestra.run.smithi104.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 132 kB 00:00 2024-04-16T12:52:52.322 INFO:teuthology.orchestra.run.smithi018.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-04-16T12:52:52.347 INFO:teuthology.orchestra.run.smithi018.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 306 kB/s | 23 kB 00:00 2024-04-16T12:52:52.398 INFO:teuthology.orchestra.run.smithi018.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-04-16T12:52:52.431 INFO:teuthology.orchestra.run.smithi018.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-04-16T12:52:52.510 INFO:teuthology.orchestra.run.smithi104.stdout:(60/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-04-16T12:52:52.523 INFO:teuthology.orchestra.run.smithi018.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 696 kB/s | 64 kB 00:00 2024-04-16T12:52:52.585 INFO:teuthology.orchestra.run.smithi104.stdout:(61/174): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2024-04-16T12:52:52.591 INFO:teuthology.orchestra.run.smithi018.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 431 kB/s | 29 kB 00:00 2024-04-16T12:52:52.613 INFO:teuthology.orchestra.run.smithi104.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 784 kB/s | 78 kB 00:00 2024-04-16T12:52:52.740 INFO:teuthology.orchestra.run.smithi018.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 396 kB/s | 136 kB 00:00 2024-04-16T12:52:52.886 INFO:teuthology.orchestra.run.smithi104.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-04-16T12:52:52.911 INFO:teuthology.orchestra.run.smithi104.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 81 kB/s | 24 kB 00:00 2024-04-16T12:52:52.937 INFO:teuthology.orchestra.run.smithi018.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 3.6 MB/s | 1.2 MB 00:00 2024-04-16T12:52:52.952 INFO:teuthology.orchestra.run.smithi104.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 436 kB/s | 18 kB 00:00 2024-04-16T12:52:52.996 INFO:teuthology.orchestra.run.smithi104.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2024-04-16T12:52:53.020 INFO:teuthology.orchestra.run.smithi104.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 473 kB/s | 32 kB 00:00 2024-04-16T12:52:53.245 INFO:teuthology.orchestra.run.smithi104.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-04-16T12:52:53.271 INFO:teuthology.orchestra.run.smithi104.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 870 kB/s | 217 kB 00:00 2024-04-16T12:52:53.295 INFO:teuthology.orchestra.run.smithi104.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-04-16T12:52:53.308 INFO:teuthology.orchestra.run.smithi018.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 3.8 MB/s | 2.2 MB 00:00 2024-04-16T12:52:53.321 INFO:teuthology.orchestra.run.smithi104.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-16T12:52:53.356 INFO:teuthology.orchestra.run.smithi104.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 701 kB/s | 41 kB 00:00 2024-04-16T12:52:53.384 INFO:teuthology.orchestra.run.smithi104.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-04-16T12:52:53.405 INFO:teuthology.orchestra.run.smithi104.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-04-16T12:52:53.435 INFO:teuthology.orchestra.run.smithi104.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-04-16T12:52:53.448 INFO:teuthology.orchestra.run.smithi104.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-04-16T12:52:53.449 INFO:teuthology.orchestra.run.smithi018.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.3 MB/s | 2.3 MB 00:00 2024-04-16T12:52:53.465 INFO:teuthology.orchestra.run.smithi104.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-04-16T12:52:53.483 INFO:teuthology.orchestra.run.smithi018.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.6 MB/s | 465 kB 00:00 2024-04-16T12:52:53.508 INFO:teuthology.orchestra.run.smithi018.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 531 kB/s | 31 kB 00:00 2024-04-16T12:52:53.592 INFO:teuthology.orchestra.run.smithi018.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 893 kB/s | 74 kB 00:00 2024-04-16T12:52:53.756 INFO:teuthology.orchestra.run.smithi104.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 133 kB/s | 39 kB 00:00 2024-04-16T12:52:53.817 INFO:teuthology.orchestra.run.smithi018.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.2 MB/s | 1.1 MB 00:00 2024-04-16T12:52:54.076 INFO:teuthology.orchestra.run.smithi104.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-16T12:52:54.091 INFO:teuthology.orchestra.run.smithi104.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 41 kB 00:00 2024-04-16T12:52:54.124 INFO:teuthology.orchestra.run.smithi104.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-16T12:52:54.142 INFO:teuthology.orchestra.run.smithi104.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 696 kB/s | 35 kB 00:00 2024-04-16T12:52:54.158 INFO:teuthology.orchestra.run.smithi104.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-16T12:52:54.191 INFO:teuthology.orchestra.run.smithi104.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-04-16T12:52:54.208 INFO:teuthology.orchestra.run.smithi104.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-04-16T12:52:54.225 INFO:teuthology.orchestra.run.smithi104.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-16T12:52:54.242 INFO:teuthology.orchestra.run.smithi104.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T12:52:54.268 INFO:teuthology.orchestra.run.smithi104.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-04-16T12:52:54.293 INFO:teuthology.orchestra.run.smithi104.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-16T12:52:54.352 INFO:teuthology.orchestra.run.smithi104.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-04-16T12:52:54.377 INFO:teuthology.orchestra.run.smithi104.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-16T12:52:54.415 INFO:teuthology.orchestra.run.smithi104.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-04-16T12:52:54.435 INFO:teuthology.orchestra.run.smithi104.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2024-04-16T12:52:54.569 INFO:teuthology.orchestra.run.smithi104.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-04-16T12:52:54.603 INFO:teuthology.orchestra.run.smithi104.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-04-16T12:52:54.637 INFO:teuthology.orchestra.run.smithi104.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-16T12:52:54.662 INFO:teuthology.orchestra.run.smithi104.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-16T12:52:54.746 INFO:teuthology.orchestra.run.smithi104.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 198 kB/s | 21 kB 00:00 2024-04-16T12:52:54.762 INFO:teuthology.orchestra.run.smithi104.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-04-16T12:52:54.891 INFO:teuthology.orchestra.run.smithi104.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.9 MB/s | 245 kB 00:00 2024-04-16T12:52:54.972 INFO:teuthology.orchestra.run.smithi104.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 2.9 MB/s | 248 kB 00:00 2024-04-16T12:52:55.022 INFO:teuthology.orchestra.run.smithi104.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-16T12:52:55.063 INFO:teuthology.orchestra.run.smithi104.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 539 kB/s | 22 kB 00:00 2024-04-16T12:52:55.155 INFO:teuthology.orchestra.run.smithi104.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-04-16T12:52:55.606 INFO:teuthology.orchestra.run.smithi104.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 4.9 MB/s | 4.1 MB 00:00 2024-04-16T12:52:55.656 INFO:teuthology.orchestra.run.smithi104.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-16T12:52:55.814 INFO:teuthology.orchestra.run.smithi104.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 123 kB/s | 19 kB 00:00 2024-04-16T12:52:55.873 INFO:teuthology.orchestra.run.smithi104.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-04-16T12:52:56.490 INFO:teuthology.orchestra.run.smithi104.stdout:(109/174): ceph-test-19.0.0-2868.gc3c87ed0.el9. 5.0 MB/s | 49 MB 00:09 2024-04-16T12:52:56.517 INFO:teuthology.orchestra.run.smithi104.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 40 kB/s | 26 kB 00:00 2024-04-16T12:52:56.574 INFO:teuthology.orchestra.run.smithi104.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-16T12:52:56.701 INFO:teuthology.orchestra.run.smithi104.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-16T12:52:56.716 INFO:teuthology.orchestra.run.smithi104.stdout:(113/174): liboath-2.6.7-2.el9.x86_64.rpm 215 kB/s | 49 kB 00:00 2024-04-16T12:52:56.992 INFO:teuthology.orchestra.run.smithi104.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-04-16T12:52:57.067 INFO:teuthology.orchestra.run.smithi104.stdout:(115/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-04-16T12:52:57.084 INFO:teuthology.orchestra.run.smithi104.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-16T12:52:57.109 INFO:teuthology.orchestra.run.smithi104.stdout:(117/174): python3-asyncssh-2.13.2-5.el9.noarch 1.4 MB/s | 548 kB 00:00 2024-04-16T12:52:57.193 INFO:teuthology.orchestra.run.smithi104.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-16T12:52:57.210 INFO:teuthology.orchestra.run.smithi104.stdout:(119/174): python3-cachetools-4.2.4-1.el9.noarc 226 kB/s | 32 kB 00:00 2024-04-16T12:52:57.277 INFO:teuthology.orchestra.run.smithi104.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2024-04-16T12:52:57.369 INFO:teuthology.orchestra.run.smithi104.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-04-16T12:52:57.402 INFO:teuthology.orchestra.run.smithi104.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-04-16T12:52:57.436 INFO:teuthology.orchestra.run.smithi104.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.3 MB/s | 303 kB 00:00 2024-04-16T12:52:57.494 INFO:teuthology.orchestra.run.smithi104.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-04-16T12:52:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 787 kB/s | 144 kB 00:00 2024-04-16T12:52:57.663 INFO:teuthology.orchestra.run.smithi104.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 64 kB/s | 11 kB 00:00 2024-04-16T12:52:57.712 INFO:teuthology.orchestra.run.smithi104.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-16T12:52:57.745 INFO:teuthology.orchestra.run.smithi104.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-04-16T12:52:57.829 INFO:teuthology.orchestra.run.smithi104.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-04-16T12:52:58.054 INFO:teuthology.orchestra.run.smithi104.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 64 kB/s | 20 kB 00:00 2024-04-16T12:52:58.130 INFO:teuthology.orchestra.run.smithi104.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-04-16T12:52:58.172 INFO:teuthology.orchestra.run.smithi104.stdout:(132/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-04-16T12:52:58.188 INFO:teuthology.orchestra.run.smithi104.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 346 kB/s | 46 kB 00:00 2024-04-16T12:52:58.289 INFO:teuthology.orchestra.run.smithi104.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 497 kB/s | 79 kB 00:00 2024-04-16T12:52:58.314 INFO:teuthology.orchestra.run.smithi104.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 406 kB/s | 58 kB 00:00 2024-04-16T12:52:58.406 INFO:teuthology.orchestra.run.smithi104.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-16T12:52:58.431 INFO:teuthology.orchestra.run.smithi104.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-04-16T12:52:58.457 INFO:teuthology.orchestra.run.smithi104.stdout:(138/174): python3-portend-3.1.0-2.el9.noarch.r 98 kB/s | 16 kB 00:00 2024-04-16T12:52:58.507 INFO:teuthology.orchestra.run.smithi104.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-16T12:52:58.532 INFO:teuthology.orchestra.run.smithi104.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-04-16T12:52:58.599 INFO:teuthology.orchestra.run.smithi104.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-16T12:52:58.624 INFO:teuthology.orchestra.run.smithi104.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-04-16T12:52:58.650 INFO:teuthology.orchestra.run.smithi104.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 415 kB/s | 59 kB 00:00 2024-04-16T12:52:58.741 INFO:teuthology.orchestra.run.smithi104.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 359 kB/s | 51 kB 00:00 2024-04-16T12:52:58.767 INFO:teuthology.orchestra.run.smithi104.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-16T12:52:58.792 INFO:teuthology.orchestra.run.smithi104.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 631 kB/s | 90 kB 00:00 2024-04-16T12:52:58.867 INFO:teuthology.orchestra.run.smithi104.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-16T12:52:58.951 INFO:teuthology.orchestra.run.smithi104.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2024-04-16T12:52:59.101 INFO:teuthology.orchestra.run.smithi104.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 620 kB/s | 192 kB 00:00 2024-04-16T12:52:59.119 INFO:teuthology.orchestra.run.smithi018.stdout:(174/174): ceph-test-19.0.0-2868.gc3c87ed0.el9. 3.2 MB/s | 49 MB 00:15 2024-04-16T12:52:59.122 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:52:59.122 INFO:teuthology.orchestra.run.smithi018.stdout:Total 12 MB/s | 228 MB 00:19 2024-04-16T12:52:59.326 INFO:teuthology.orchestra.run.smithi104.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-04-16T12:52:59.452 INFO:teuthology.orchestra.run.smithi104.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 18 MB/s | 2.3 MB 00:00 2024-04-16T12:52:59.500 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-04-16T12:52:59.528 INFO:teuthology.orchestra.run.smithi104.stdout:(152/174): librados2-19.0.0-2868.gc3c87ed0.el9. 5.9 MB/s | 3.4 MB 00:00 2024-04-16T12:52:59.585 INFO:teuthology.orchestra.run.smithi104.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 14 MB/s | 1.8 MB 00:00 2024-04-16T12:52:59.602 INFO:teuthology.orchestra.run.smithi104.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 551 kB/s | 41 kB 00:00 2024-04-16T12:52:59.628 INFO:teuthology.orchestra.run.smithi104.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-04-16T12:52:59.653 INFO:teuthology.orchestra.run.smithi104.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-04-16T12:52:59.703 INFO:teuthology.orchestra.run.smithi104.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 956 kB/s | 71 kB 00:00 2024-04-16T12:52:59.720 INFO:teuthology.orchestra.run.smithi104.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 545 kB/s | 36 kB 00:00 2024-04-16T12:52:59.770 INFO:teuthology.orchestra.run.smithi104.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-16T12:52:59.795 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-04-16T12:52:59.795 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-04-16T12:52:59.804 INFO:teuthology.orchestra.run.smithi104.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-04-16T12:52:59.829 INFO:teuthology.orchestra.run.smithi104.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 391 kB/s | 23 kB 00:00 2024-04-16T12:52:59.863 INFO:teuthology.orchestra.run.smithi104.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-16T12:52:59.889 INFO:teuthology.orchestra.run.smithi104.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-16T12:52:59.914 INFO:teuthology.orchestra.run.smithi104.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-16T12:52:59.930 INFO:teuthology.orchestra.run.smithi104.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-16T12:52:59.948 INFO:teuthology.orchestra.run.smithi104.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 860 kB/s | 29 kB 00:00 2024-04-16T12:53:00.015 INFO:teuthology.orchestra.run.smithi104.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-04-16T12:53:00.081 INFO:teuthology.orchestra.run.smithi104.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 16 MB/s | 2.2 MB 00:00 2024-04-16T12:53:00.132 INFO:teuthology.orchestra.run.smithi104.stdout:(169/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-04-16T12:53:00.165 INFO:teuthology.orchestra.run.smithi104.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-04-16T12:53:00.219 INFO:teuthology.orchestra.run.smithi104.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-16T12:53:00.241 INFO:teuthology.orchestra.run.smithi104.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 286 kB/s | 31 kB 00:00 2024-04-16T12:53:00.275 INFO:teuthology.orchestra.run.smithi104.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.9 MB/s | 1.1 MB 00:00 2024-04-16T12:53:00.300 INFO:teuthology.orchestra.run.smithi104.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 892 kB/s | 74 kB 00:00 2024-04-16T12:53:00.305 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:53:00.305 INFO:teuthology.orchestra.run.smithi104.stdout:Total 12 MB/s | 228 MB 00:19 2024-04-16T12:53:00.695 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-04-16T12:53:00.970 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-04-16T12:53:00.970 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-04-16T12:53:01.999 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-04-16T12:53:01.999 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-04-16T12:53:03.007 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-04-16T12:53:03.008 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-04-16T12:53:09.137 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-04-16T12:53:09.247 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T12:53:09.273 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T12:53:09.303 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:53:09.313 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:53:09.364 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T12:53:09.416 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T12:53:09.449 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T12:53:09.474 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T12:53:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T12:53:09.890 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-04-16T12:53:09.991 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T12:53:10.034 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T12:53:10.078 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:53:10.082 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T12:53:10.098 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T12:53:10.121 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T12:53:10.150 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:10.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T12:53:10.208 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T12:53:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T12:53:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T12:53:10.401 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:10.430 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:53:10.471 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T12:53:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T12:53:10.728 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T12:53:10.755 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:10.843 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:10.859 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T12:53:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:53:10.918 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:53:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T12:53:10.974 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:53:10.990 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:53:11.039 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:11.069 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:11.160 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:11.167 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:53:11.189 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:53:11.205 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:53:11.235 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T12:53:11.237 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T12:53:11.413 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T12:53:11.437 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T12:53:11.463 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T12:53:11.490 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:11.556 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:53:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:11.599 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:53:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:53:11.673 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T12:53:11.692 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:11.721 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T12:53:11.738 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:53:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:11.758 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T12:53:11.937 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:53:11.960 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:11.979 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T12:53:12.015 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T12:53:12.076 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T12:53:12.171 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T12:53:12.209 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T12:53:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T12:53:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T12:53:12.279 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T12:53:12.364 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T12:53:12.388 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:53:12.424 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T12:53:12.462 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T12:53:12.537 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T12:53:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T12:53:12.629 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T12:53:12.662 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T12:53:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T12:53:12.705 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T12:53:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T12:53:12.790 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:12.811 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T12:53:12.853 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:12.855 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T12:53:12.883 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T12:53:12.958 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T12:53:12.998 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T12:53:13.081 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T12:53:13.090 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T12:53:13.194 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T12:53:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T12:53:13.287 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T12:53:13.302 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T12:53:13.317 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T12:53:13.345 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T12:53:13.391 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T12:53:13.462 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T12:53:13.515 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T12:53:13.553 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T12:53:13.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T12:53:13.656 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T12:53:13.695 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T12:53:13.728 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T12:53:13.756 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T12:53:13.826 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T12:53:13.861 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T12:53:13.866 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T12:53:13.904 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T12:53:13.933 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T12:53:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T12:53:14.001 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T12:53:14.045 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T12:53:14.056 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T12:53:14.098 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:53:14.109 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:53:14.129 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T12:53:14.149 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T12:53:14.196 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T12:53:14.234 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T12:53:14.260 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T12:53:14.264 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T12:53:14.308 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T12:53:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T12:53:14.738 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T12:53:14.823 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T12:53:14.824 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T12:53:14.877 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T12:53:14.911 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T12:53:14.996 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T12:53:15.012 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T12:53:15.048 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:53:15.059 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T12:53:15.075 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T12:53:15.098 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T12:53:15.128 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T12:53:15.146 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T12:53:15.183 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T12:53:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T12:53:15.216 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T12:53:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T12:53:15.279 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T12:53:15.323 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T12:53:15.367 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T12:53:15.419 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T12:53:15.461 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T12:53:15.490 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T12:53:15.602 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T12:53:15.653 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T12:53:15.678 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T12:53:15.681 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T12:53:15.729 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T12:53:15.751 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T12:53:15.795 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T12:53:15.827 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T12:53:15.870 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T12:53:15.910 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T12:53:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T12:53:15.938 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T12:53:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T12:53:15.989 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T12:53:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T12:53:16.043 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T12:53:16.107 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T12:53:16.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T12:53:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T12:53:16.176 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T12:53:16.222 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T12:53:16.259 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T12:53:16.278 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T12:53:16.306 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T12:53:16.319 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T12:53:16.344 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T12:53:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T12:53:16.460 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T12:53:16.484 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T12:53:16.534 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T12:53:16.563 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T12:53:16.604 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T12:53:16.652 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T12:53:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T12:53:16.698 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T12:53:16.729 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T12:53:16.769 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T12:53:16.798 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T12:53:16.819 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T12:53:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T12:53:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T12:53:16.913 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T12:53:16.945 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T12:53:16.977 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:53:17.004 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T12:53:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T12:53:17.044 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T12:53:17.078 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T12:53:17.118 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T12:53:17.148 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T12:53:17.151 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T12:53:17.202 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T12:53:17.229 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T12:53:17.250 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T12:53:17.257 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T12:53:17.291 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T12:53:17.306 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T12:53:17.338 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T12:53:17.376 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T12:53:17.468 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T12:53:17.489 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T12:53:17.539 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T12:53:17.558 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T12:53:17.607 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T12:53:17.641 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T12:53:17.666 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T12:53:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T12:53:17.704 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T12:53:17.737 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T12:53:17.767 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:53:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T12:53:17.795 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T12:53:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T12:53:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T12:53:17.868 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T12:53:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T12:53:17.930 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T12:53:18.006 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T12:53:18.039 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T12:53:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T12:53:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T12:53:18.151 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T12:53:18.255 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T12:53:18.345 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T12:53:18.388 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T12:53:18.428 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T12:53:18.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T12:53:18.572 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T12:53:18.622 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T12:53:18.629 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T12:53:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T12:53:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T12:53:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T12:53:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T12:53:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T12:53:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T12:53:19.109 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T12:53:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T12:53:19.352 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T12:53:19.407 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T12:53:19.441 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T12:53:19.489 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T12:53:19.567 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T12:53:19.608 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T12:53:19.786 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T12:53:19.815 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T12:53:19.861 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T12:53:19.892 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T12:53:19.971 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T12:53:20.538 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T12:53:20.644 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T12:53:21.264 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T12:53:21.346 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T12:53:21.377 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T12:53:21.408 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T12:53:21.436 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T12:53:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T12:53:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:53:21.866 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T12:53:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:53:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T12:53:21.947 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T12:53:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T12:53:21.978 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T12:53:22.011 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T12:53:22.040 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T12:53:22.347 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T12:53:22.375 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:53:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T12:53:22.465 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T12:53:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:53:22.496 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T12:53:22.532 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T12:53:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:53:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T12:53:22.997 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T12:53:23.020 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:53:23.074 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T12:53:23.104 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T12:53:24.906 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:24.950 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:25.294 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:25.335 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:25.525 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:25.561 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:53:25.653 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:53:25.653 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T12:53:25.653 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T12:53:25.653 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:25.688 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:53:25.888 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T12:53:25.928 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:53:26.004 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T12:53:26.005 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T12:53:26.005 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T12:53:26.005 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:26.038 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:53:37.491 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-04-16T12:53:37.492 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:53:37.676 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:53:37.676 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:37.676 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T12:53:37.676 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:37.844 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T12:53:37.844 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-04-16T12:53:37.844 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-04-16T12:53:37.845 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:38.007 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:53:38.024 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T12:53:38.024 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:38.024 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T12:53:38.024 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:39.207 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:53:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:39.472 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:53:39.495 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:39.510 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T12:53:39.537 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:39.769 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:53:39.795 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T12:53:39.795 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:39.795 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T12:53:39.795 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:53:39.796 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T12:53:39.796 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:39.965 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:53:39.987 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:53:39.988 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:39.988 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T12:53:39.988 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:53:39.988 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:53:39.988 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:40.083 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T12:53:40.236 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:40.346 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T12:53:40.529 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:53:40.556 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:53:40.589 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T12:53:40.651 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T12:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:53:40.782 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:53:40.811 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T12:53:40.844 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T12:53:40.905 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T12:53:40.934 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:53:41.768 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:53:41.798 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:53:41.969 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T12:53:42.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:53:42.813 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:53:42.832 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:53:42.936 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:53:42.964 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T12:53:43.003 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:53:43.104 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T12:53:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T12:53:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:53:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:53:43.166 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:43.166 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T12:53:43.166 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:53:43.166 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:53:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:43.210 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:53:43.221 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:53:43.274 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T12:53:43.275 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T12:53:43.304 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:53:43.328 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T12:53:43.329 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:43.329 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T12:53:43.329 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:53:43.329 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T12:53:43.329 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:43.380 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:53:43.392 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T12:53:43.444 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T12:53:44.226 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T12:53:44.255 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:53:44.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:53:44.335 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T12:53:44.343 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:53:44.343 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.343 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T12:53:44.343 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:44.365 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T12:53:44.393 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:44.397 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:44.419 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:44.419 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.419 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T12:53:44.420 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:53:44.420 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:53:44.420 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:44.449 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:53:44.472 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T12:53:44.472 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.472 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T12:53:44.472 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:44.516 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:44.540 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:44.540 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.540 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T12:53:44.541 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:53:44.541 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T12:53:44.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:44.747 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:53:44.770 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:53:44.770 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.770 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T12:53:44.771 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:53:44.771 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:53:44.771 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:53:44.842 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T12:53:44.866 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:53:49.413 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:53:49.453 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T12:53:49.484 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T12:53:49.511 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T12:53:49.619 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:53:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T12:53:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T12:53:49.693 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T12:53:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T12:53:49.819 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T12:53:49.859 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T12:53:49.910 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T12:53:49.912 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T12:53:49.962 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T12:53:50.002 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T12:53:50.029 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T12:53:50.038 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T12:53:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T12:53:50.067 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T12:53:50.096 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T12:53:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T12:53:50.167 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T12:53:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T12:53:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T12:53:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T12:53:50.258 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T12:53:50.272 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T12:53:50.298 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T12:53:50.328 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T12:53:50.388 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T12:53:50.460 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T12:53:50.502 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T12:53:50.871 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:50.918 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:50.939 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:51.211 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T12:53:51.767 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T12:53:51.848 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T12:53:51.899 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T12:53:51.988 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T12:53:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T12:53:52.049 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T12:53:52.075 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T12:53:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T12:53:52.102 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T12:53:52.103 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:53:52.181 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T12:53:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:53:52.222 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T12:53:52.260 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T12:53:52.260 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:53:52.323 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T12:53:52.353 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:53:52.359 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T12:53:52.384 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T12:53:52.397 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T12:53:52.410 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T12:53:52.434 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T12:53:52.437 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T12:53:52.437 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:53:52.454 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T12:53:52.479 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T12:53:52.515 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T12:53:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T12:53:52.561 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T12:53:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T12:53:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:53:52.598 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T12:53:52.617 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T12:53:52.646 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T12:53:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T12:53:52.668 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:53:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T12:53:52.693 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T12:53:52.701 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:52.701 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T12:53:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T12:53:52.773 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T12:53:52.809 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T12:53:52.863 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T12:53:52.888 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:52.888 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:53:52.903 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T12:53:52.928 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T12:53:52.953 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T12:53:52.971 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:53:52.979 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:53:53.003 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:53:53.012 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T12:53:53.019 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:53.020 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:53.029 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T12:53:53.057 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T12:53:53.080 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T12:53:53.146 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:53:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T12:53:53.207 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:53:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T12:53:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:53:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T12:53:53.391 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T12:53:53.416 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T12:53:53.484 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:53:58.567 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T12:53:58.568 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T12:53:58.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T12:53:58.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T12:53:58.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T12:53:58.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:58.570 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T12:53:58.571 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T12:53:58.572 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T12:53:58.573 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T12:53:58.574 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T12:53:58.575 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T12:53:58.576 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:53:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T12:53:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T12:53:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T12:53:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T12:53:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T12:53:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T12:53:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:53:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T12:53:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T12:53:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T12:53:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T12:53:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T12:53:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T12:53:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T12:53:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T12:53:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T12:53:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T12:53:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T12:53:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T12:53:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T12:53:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T12:53:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T12:53:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T12:53:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T12:53:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T12:53:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T12:53:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T12:53:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T12:53:59.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T12:53:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T12:53:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T12:53:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T12:53:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T12:53:59.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T12:53:59.044 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T12:53:59.045 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T12:53:59.046 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T12:53:59.047 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T12:53:59.048 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T12:53:59.050 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T12:53:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T12:53:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T12:53:59.051 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T12:53:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T12:53:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T12:53:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T12:53:59.052 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T12:53:59.053 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T12:53:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T12:53:59.055 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T12:53:59.056 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T12:53:59.057 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T12:53:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T12:53:59.059 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T12:53:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T12:53:59.061 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T12:53:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T12:53:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T12:53:59.062 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T12:53:59.063 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T12:53:59.064 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T12:54:01.472 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T12:54:01.472 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:01.472 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-04-16T12:54:01.472 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.472 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T12:54:01.473 INFO:teuthology.orchestra.run.smithi104.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.474 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T12:54:01.475 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.476 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.477 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.478 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.478 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.478 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.479 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.479 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.479 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.479 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.480 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.480 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.480 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.480 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.481 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T12:54:01.482 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T12:54:01.482 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T12:54:01.482 INFO:teuthology.orchestra.run.smithi104.stdout: jq-1.6-16.el9.x86_64 2024-04-16T12:54:01.482 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T12:54:01.482 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T12:54:01.483 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T12:54:01.484 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.485 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T12:54:01.485 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T12:54:01.485 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T12:54:01.485 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T12:54:01.486 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T12:54:01.486 INFO:teuthology.orchestra.run.smithi104.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T12:54:01.486 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T12:54:01.486 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T12:54:01.487 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.487 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T12:54:01.487 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T12:54:01.487 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T12:54:01.488 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T12:54:01.489 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T12:54:01.489 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T12:54:01.489 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T12:54:01.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T12:54:01.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T12:54:01.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T12:54:01.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T12:54:01.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T12:54:01.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T12:54:01.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T12:54:01.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T12:54:01.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T12:54:01.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T12:54:01.497 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T12:54:01.497 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T12:54:01.497 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T12:54:01.497 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T12:54:01.497 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T12:54:01.498 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T12:54:01.498 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T12:54:01.498 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T12:54:01.498 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T12:54:01.507 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T12:54:01.518 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T12:54:01.518 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T12:54:01.518 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T12:54:01.519 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T12:54:01.520 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T12:54:01.542 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T12:54:01.543 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T12:54:01.544 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T12:54:01.545 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T12:54:01.546 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.547 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:01.548 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-04-16T12:54:01.833 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T12:54:01.833 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T12:54:01.834 INFO:teuthology.orchestra.run.smithi018.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.835 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.836 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.837 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.838 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.838 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.838 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.838 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T12:54:01.839 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: jq-1.6-16.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.840 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T12:54:01.841 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T12:54:01.842 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T12:54:01.843 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T12:54:01.844 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T12:54:01.846 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.847 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T12:54:01.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T12:54:01.849 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T12:54:01.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T12:54:01.851 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T12:54:01.882 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T12:54:01.883 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T12:54:01.883 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:01.883 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-04-16T12:54:01.933 DEBUG:teuthology.parallel:result is None 2024-04-16T12:54:02.315 DEBUG:teuthology.parallel:result is None 2024-04-16T12:54:02.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:54:02.480 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T12:54:02.504 INFO:teuthology.orchestra.run.smithi018.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:54:02.505 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:54:02.505 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T12:54:02.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:54:02.851 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T12:54:02.878 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:54:02.878 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T12:54:02.878 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T12:54:02.880 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T12:54:02.880 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:02.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T12:54:02.926 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:02.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T12:54:02.964 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T12:54:02.964 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:02.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T12:54:02.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T12:54:03.077 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:03.078 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T12:54:03.114 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T12:54:03.186 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T12:54:03.186 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:03.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T12:54:03.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T12:54:03.290 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:03.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T12:54:03.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T12:54:03.402 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T12:54:03.402 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:03.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T12:54:03.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T12:54:03.509 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:03.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T12:54:03.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T12:54:03.622 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T12:54:03.833 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T12:54:03.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-04-16T12:54:03.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-04-16T12:54:03.894 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T12:54:03.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T12:54:03.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T12:54:03.965 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T12:54:03.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T12:54:03.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T12:54:04.057 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T12:54:04.058 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T12:54:04.058 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T12:54:04.058 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:04.058 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T12:54:04.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:04.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:04.239 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:04.239 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T12:54:04.256 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:04.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:04.423 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T12:54:04.424 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T12:54:04.424 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/recovery-fs}', 'email': None, 'first_in_suite': False, 'job_id': '7658129', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMEVUKDqZzMfUSudXchvN2uYeGidekfIFWKsXHu/gZLhfwu8TUbiUkyD0uhXn/7Cg0L0ImEityTn4xHbacMWAo=', 'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx6p853EcotvH90NVoZD9xtnANTx3LRiJtJMb924TOc8C3Sl4x/u8/L59YbBM/3i8CQ3PwcphraGV8X+DY+2Kc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_fs']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T12:54:04.427 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T12:54:04.432 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T12:54:04.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T12:54:04.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T12:54:04.542 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:04.542 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T12:54:04.584 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T12:54:04.586 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-04-16T12:54:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T12:54:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-16 12:53:53.850335076 +0000 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-16 12:51:45.092838448 +0000 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-16 12:51:45.092838448 +0000 2024-04-16T12:54:04.641 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-16 12:51:45.092838448 +0000 2024-04-16T12:54:04.641 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T12:54:04.709 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-16T12:54:04.709 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-16T12:54:04.710 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000104323 s, 4.9 MB/s 2024-04-16T12:54:04.711 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T12:54:04.768 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-16 12:53:53.851335064 +0000 2024-04-16T12:54:04.829 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-16 12:51:45.457834058 +0000 2024-04-16T12:54:04.830 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-16 12:51:45.457834058 +0000 2024-04-16T12:54:04.830 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-16 12:51:45.457834058 +0000 2024-04-16T12:54:04.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T12:54:04.903 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-16T12:54:04.904 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-16T12:54:04.904 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000101929 s, 5.0 MB/s 2024-04-16T12:54:04.904 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T12:54:04.995 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-04-16T12:54:05.046 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-16 12:53:53.851335064 +0000 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-16 12:51:45.833829537 +0000 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-16 12:51:45.833829537 +0000 2024-04-16T12:54:05.047 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-16 12:51:45.833829537 +0000 2024-04-16T12:54:05.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T12:54:05.115 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-16T12:54:05.115 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-16T12:54:05.115 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.8281e-05 s, 5.2 MB/s 2024-04-16T12:54:05.116 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T12:54:05.173 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-16 12:53:53.851335064 +0000 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-16 12:51:46.212824979 +0000 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-16 12:51:46.212824979 +0000 2024-04-16T12:54:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-16 12:51:46.212824979 +0000 2024-04-16T12:54:05.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T12:54:05.296 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-16T12:54:05.296 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-16T12:54:05.296 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 8.2195e-05 s, 6.2 MB/s 2024-04-16T12:54:05.297 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T12:54:05.354 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:05.355 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:05.355 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T12:54:05.372 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T12:54:05.372 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-04-16T12:54:05.430 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T12:54:05.430 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-16 12:53:53.492924404 +0000 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-16 12:51:42.757755806 +0000 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-16 12:51:42.757755806 +0000 2024-04-16T12:54:05.431 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-16 12:51:42.757755806 +0000 2024-04-16T12:54:05.431 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T12:54:05.500 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-16T12:54:05.500 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-16T12:54:05.500 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000210287 s, 2.4 MB/s 2024-04-16T12:54:05.501 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T12:54:05.560 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-16 12:53:53.492924404 +0000 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-16 12:51:43.153751365 +0000 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-16 12:51:43.153751365 +0000 2024-04-16T12:54:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-16 12:51:43.153751365 +0000 2024-04-16T12:54:05.619 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T12:54:05.691 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-16T12:54:05.691 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-16T12:54:05.691 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000228739 s, 2.2 MB/s 2024-04-16T12:54:05.692 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T12:54:05.749 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-16 12:53:53.492924404 +0000 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-16 12:51:43.529747147 +0000 2024-04-16T12:54:05.816 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-16 12:51:43.529747147 +0000 2024-04-16T12:54:05.817 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-16 12:51:43.529747147 +0000 2024-04-16T12:54:05.817 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T12:54:05.884 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-16T12:54:05.884 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-16T12:54:05.884 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000176783 s, 2.9 MB/s 2024-04-16T12:54:05.885 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T12:54:05.942 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-04-16T12:54:05.997 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-16 12:53:53.493924393 +0000 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-16 12:51:43.954742381 +0000 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-16 12:51:43.954742381 +0000 2024-04-16T12:54:05.998 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-04-16 12:51:43.954742381 +0000 2024-04-16T12:54:05.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T12:54:06.064 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-16T12:54:06.064 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-16T12:54:06.064 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00024621 s, 2.1 MB/s 2024-04-16T12:54:06.065 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T12:54:06.123 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:06.123 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T12:54:06.123 INFO:tasks.ceph:Generating config... 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] pid file = 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T12:54:06.125 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T12:54:06.125 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-16T12:54:06.125 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T12:54:06.125 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T12:54:06.125 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T12:54:06.125 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T12:54:06.125 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T12:54:06.126 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T12:54:06.126 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T12:54:06.126 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T12:54:06.127 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T12:54:06.127 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T12:54:06.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T12:54:06.192 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T12:54:06.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T12:54:06.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:54:06.274 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.104'), ('mon.c', '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]')] 2024-04-16T12:54:06.274 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T12:54:06.275 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:06.275 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T12:54:06.330 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.104 --addv c '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:06.417 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid 4f03925b-4efb-4ceb-afe9-e5d42c409d27 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 4f03925b-4efb-4ceb-afe9-e5d42c409d27 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-04-16T12:54:06.417292+0000 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-04-16T12:54:06.417292+0000 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.b 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-16T12:54:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T12:54:06.420 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T12:54:06.446 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4f03925b-4efb-4ceb-afe9-e5d42c409d27... 2024-04-16T12:54:06.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T12:54:06.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T12:54:06.541 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-16T12:54:06.542 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-16T12:54:06.543 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-16T12:54:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]" 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 4f03925b-4efb-4ceb-afe9-e5d42c409d27 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-16T12:54:06.545 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-16T12:54:06.546 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-16T12:54:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-16T12:54:06.558 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-16T12:54:06.559 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-16T12:54:06.559 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-16T12:54:06.559 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-16T12:54:06.559 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.560 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-16T12:54:06.560 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-16T12:54:06.563 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-16T12:54:06.564 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: mon down mkfs grace = 300 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-16T12:54:06.565 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-04-16T12:54:06.566 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug zombie log segments = True 2024-04-16T12:54:06.567 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-16T12:54:06.567 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-04-16T12:54:06.567 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-16T12:54:06.567 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-16T12:54:06.567 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-16T12:54:06.568 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-04-16T12:54:06.569 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.577 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-04-16T12:54:06.578 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-04-16T12:54:06.579 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.580 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-04-16T12:54:06.580 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-04-16T12:54:06.580 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-04-16T12:54:06.581 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.18,172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790]" 2024-04-16T12:54:06.581 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on skipped message = False 2024-04-16T12:54:06.581 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = 4f03925b-4efb-4ceb-afe9-e5d42c409d27 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.582 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.583 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 20 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 20 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-04-16T12:54:06.584 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 10 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-16T12:54:06.585 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-16T12:54:06.586 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon down mkfs grace = 300 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: mon op complaint time = 120 2024-04-16T12:54:06.587 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: client mount timeout = 600 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-04-16T12:54:06.588 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout:[mds] 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds = 20 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds balancer = 20 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug frag = True 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug scatterstat = True 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug zombie log segments = True 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: mds op complaint time = 180 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: mds verify scatter = True 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-04-16T12:54:06.589 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-04-16T12:54:06.590 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T12:54:06.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T12:54:06.680 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T12:54:06.680 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:06.681 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T12:54:06.700 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:06.700 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T12:54:06.763 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:54:06.763 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:06.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T12:54:06.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:54:06.845 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:06.845 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:06.900 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:54:06.900 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:06.900 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T12:54:06.900 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T12:54:06.943 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:06.944 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:06.999 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T12:54:07.000 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T12:54:07.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T12:54:07.056 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T12:54:07.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T12:54:07.123 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T12:54:07.125 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T12:54:07.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T12:54:07.183 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T12:54:07.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T12:54:07.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T12:54:07.318 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T12:54:07.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-16T12:54:07.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T12:54:07.406 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T12:54:07.408 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T12:54:07.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T12:54:07.534 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T12:54:07.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-16T12:54:07.564 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T12:54:07.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T12:54:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T12:54:07.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-16T12:54:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-16T12:54:07.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T12:54:07.770 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-16T12:54:07.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-16T12:54:07.830 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-16T12:54:07.846 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T12:54:07.846 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T12:54:07.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T12:54:07.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:07.878 INFO:tasks.ceph:role: osd.0 2024-04-16T12:54:07.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:54:07.879 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:07.948 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:07.979 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-16T12:54:07.980 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-16T12:54:07.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T12:54:08.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T12:54:08.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T12:54:08.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:08.194 INFO:tasks.ceph:role: osd.1 2024-04-16T12:54:08.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:54:08.194 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:08.262 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:08.294 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-16T12:54:08.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-16T12:54:08.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T12:54:08.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T12:54:08.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T12:54:08.513 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:08.513 INFO:tasks.ceph:role: osd.2 2024-04-16T12:54:08.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:54:08.513 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T12:54:08.581 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:08.581 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:08.582 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:08.616 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-16T12:54:08.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-16T12:54:08.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T12:54:08.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T12:54:08.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T12:54:08.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:08.837 INFO:tasks.ceph:role: osd.3 2024-04-16T12:54:08.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:54:08.837 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T12:54:08.923 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:08.924 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:08.942 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-16T12:54:08.943 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-16T12:54:08.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T12:54:09.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T12:54:09.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T12:54:09.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:09.188+0000 7f28c209d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T12:54:12.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T12:54:12.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:12.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.175+0000 7f5fd9f6b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T12:54:12.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.175+0000 7f5fd9f6b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T12:54:12.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.175+0000 7f5fd9f6b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:54:12.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.175+0000 7f5fd9f6b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:54:12.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.175+0000 7f5fd9f6b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T12:54:12.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:12.176+0000 7f5fd9f6b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T12:54:15.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T12:54:15.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:15.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T12:54:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T12:54:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:54:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:54:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T12:54:15.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:15.160+0000 7f60af60e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T12:54:18.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T12:54:18.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T12:54:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T12:54:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:54:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:54:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T12:54:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:18.139+0000 7f385880c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T12:54:20.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T12:54:21.034 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T12:54:21.068 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:21.068 INFO:tasks.ceph:role: osd.4 2024-04-16T12:54:21.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:54:21.068 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T12:54:21.147 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:21.147 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:21.147 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:21.147 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:21.148 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:21.665 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-16T12:54:21.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-16T12:54:21.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T12:54:21.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T12:54:21.818 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T12:54:21.891 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:21.891 INFO:tasks.ceph:role: osd.5 2024-04-16T12:54:21.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:54:21.891 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T12:54:21.968 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:21.968 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:21.968 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:21.968 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:21.968 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:21.969 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:21.969 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:21.969 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:21.969 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:21.969 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:22.414 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-16T12:54:22.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-16T12:54:22.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T12:54:22.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T12:54:22.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T12:54:22.608 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:22.608 INFO:tasks.ceph:role: osd.6 2024-04-16T12:54:22.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:54:22.608 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T12:54:22.682 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:22.683 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:23.168 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-16T12:54:23.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-16T12:54:23.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T12:54:23.320 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T12:54:23.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T12:54:23.426 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T12:54:23.426 INFO:tasks.ceph:role: osd.7 2024-04-16T12:54:23.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:54:23.426 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T12:54:23.502 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T12:54:24.003 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-16T12:54:24.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-16T12:54:24.004 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T12:54:24.140 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T12:54:24.176 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.282+0000 7ffba5b9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.282+0000 7ffba5b9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.282+0000 7ffba5b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.282+0000 7ffba5b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.282+0000 7ffba5b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T12:54:24.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:24.283+0000 7ffba5b9a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T12:54:27.135 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T12:54:27.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:27.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T12:54:27.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T12:54:27.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:54:27.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:54:27.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T12:54:27.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:27.264+0000 7f1e42615640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T12:54:30.122 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T12:54:30.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.248+0000 7ff1bda19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.248+0000 7ff1bda19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.248+0000 7ff1bda19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.248+0000 7ff1bda19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.248+0000 7ff1bda19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T12:54:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:30.249+0000 7ff1bda19640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T12:54:33.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T12:54:33.129 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T12:54:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T12:54:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:54:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:54:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T12:54:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:33.224+0000 7f9a77c17640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T12:54:34.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:34.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:54:36.105 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T12:54:36.139 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T12:54:36.139 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T12:54:36.172 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T12:54:36.248 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-16T12:54:36.324 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T12:54:36.394 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T12:54:36.464 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T12:54:36.533 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:36.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T12:54:36.604 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T12:54:36.639 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T12:54:36.710 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-16T12:54:36.782 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T12:54:36.852 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T12:54:36.923 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.924 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T12:54:36.992 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:36.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T12:54:37.062 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:37.062 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T12:54:37.080 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:37.080 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-16T12:54:37.137 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:37.137 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-16T12:54:37.158 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:37.158 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-16T12:54:37.213 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T12:54:37.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T12:54:37.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T12:54:37.257 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5m1xJfAxAA5j4qhh5/QzTptJcne/pWpw== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mh+PhChAA6REyczyZ8C29DaMWaSb/XQ== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mHuqnEhAAie2gNKWh8ofjiVhlw+skVg== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDxdB5m3udFCxAAHUz9NajeHygA280TMvWuiQ== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD0dB5mDwGFChAAVTMqgqr0q5jhbnf2Y1cz1g== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD3dB5miDWaCRAAzjMdwEgTWGewfcaPvI99PQ== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD6dB5munFVCBAA32AeqtGoRUixdJpf/Uibmg== 2024-04-16T12:54:37.258 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mxkJOBxAAtF9N0xBKy6v98AFpWjNaeQ== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5medYxGBAAJOkPNbQuQhLwzUd2IqsUVg== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mpBDVHxAA11m64DDO7u1yP/FITsFjoA== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAAdR5mwnzeEBAAlEJNHRcTetPZP9uCnJOW5w== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQADdR5meyjHDxAAonZdTy5FF3oHPSQtfNoXNQ== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAGdR5mMenaDhAAuN9ijvvKCtgB30d4DV4DVg== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAJdR5mtuxkDRAA6b0XI3yPfCvyRWjT3GouPA== 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-16T12:54:37.259 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mScpUJBAAg92NknOEgwOgxRDmtBQiFA== 2024-04-16T12:54:37.260 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2024-04-16T12:54:37.260 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5msRhKKhAAe2E5w8hxs8naGLC5aHphbw== 2024-04-16T12:54:37.260 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-04-16T12:54:37.261 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5m7GfsLRAAG8t/E/1ICOiV/Ztr0wP1sA== 2024-04-16T12:54:37.261 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2024-04-16T12:54:37.261 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mUkl8MRAA3giH0rzdMor0DjXpDvDhww== 2024-04-16T12:54:37.281 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5m1xJfAxAA5j4qhh5/QzTptJcne/pWpw== 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mh+PhChAA6REyczyZ8C29DaMWaSb/XQ== 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mHuqnEhAAie2gNKWh8ofjiVhlw+skVg== 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-04-16T12:54:37.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDxdB5m3udFCxAAHUz9NajeHygA280TMvWuiQ== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD0dB5mDwGFChAAVTMqgqr0q5jhbnf2Y1cz1g== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD3dB5miDWaCRAAzjMdwEgTWGewfcaPvI99PQ== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD6dB5munFVCBAA32AeqtGoRUixdJpf/Uibmg== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mxkJOBxAAtF9N0xBKy6v98AFpWjNaeQ== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5medYxGBAAJOkPNbQuQhLwzUd2IqsUVg== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mpBDVHxAA11m64DDO7u1yP/FITsFjoA== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAAdR5mwnzeEBAAlEJNHRcTetPZP9uCnJOW5w== 2024-04-16T12:54:37.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQADdR5meyjHDxAAonZdTy5FF3oHPSQtfNoXNQ== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAGdR5mMenaDhAAuN9ijvvKCtgB30d4DV4DVg== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAJdR5mtuxkDRAA6b0XI3yPfCvyRWjT3GouPA== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mScpUJBAAg92NknOEgwOgxRDmtBQiFA== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5msRhKKhAAe2E5w8hxs8naGLC5aHphbw== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5m7GfsLRAAG8t/E/1ICOiV/Ztr0wP1sA== 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2024-04-16T12:54:37.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvdB5mUkl8MRAA3giH0rzdMor0DjXpDvDhww== 2024-04-16T12:54:37.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:54:37.314 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:54:37.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.385 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.560 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.616 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.674 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:54:37.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T12:54:37.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.789 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T12:54:37.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:37.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:38.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:38.029 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:38.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:38.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T12:54:38.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.327 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T12:54:38.384 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T12:54:38.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T12:54:38.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:54:38.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T12:54:38.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T12:54:38.579 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:54:38.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T12:54:38.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T12:54:38.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T12:54:38.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T12:54:38.906 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:38.909 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T12:54:38.962 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T12:54:38.963 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T12:54:38.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T12:54:38.978 INFO:tasks.ceph.mon.a:Started 2024-04-16T12:54:38.979 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T12:54:38.979 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T12:54:39.020 INFO:tasks.ceph.mon.b:Started 2024-04-16T12:54:39.021 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T12:54:39.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T12:54:39.024 INFO:tasks.ceph.mon.c:Started 2024-04-16T12:54:39.025 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T12:54:39.025 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T12:54:39.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T12:54:39.032 INFO:tasks.ceph.mgr.y:Started 2024-04-16T12:54:39.032 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T12:54:39.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T12:54:39.035 INFO:tasks.ceph.mgr.x:Started 2024-04-16T12:54:39.035 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T12:54:39.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T12:54:39.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.138+0000 7f129abba640 1 Processor -- start 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 -- start start 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12940b6290 con 0x7f1294070960 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f12940b0f20 con 0x7f1294070580 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f129abba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f12940b7180 con 0x7f12940ae3f0 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.139+0000 7f1298956640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1299157640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1294070960 0x7f12940d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35900/0 (socket says 172.21.15.18:35900) 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1299157640 1 -- 172.21.15.18:0/2715134752 learned_addr learned my addr 172.21.15.18:0/2715134752 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.140+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.341+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:39.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:39.742+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T12:54:40.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:40.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:40.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:40.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:40.543+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 msgr2=0x7f12940cdf90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12940ae3f0 0x7f12940cdf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 msgr2=0x7f12940b09e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.18:3300/0 conn(0x7f1294070580 0x7f12940b09e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 -- 172.21.15.18:0/2715134752 >> v1:172.21.15.18:6789/0 conn(0x7f1294070960 legacy=0x7f12940d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 -- 172.21.15.18:0/2715134752 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12940b6570 con 0x7f12780036e0 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f12927fc640 1 -- 172.21.15.18:0/2715134752 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f12940b0f20 con 0x7f1278007350 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T12:54:42.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:42.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:42.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.141+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.342+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.342+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T12:54:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.342+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.342+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.342+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T12:54:42.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.743+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.743+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T12:54:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.743+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.743+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:42.743+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T12:54:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:43.544+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:43.545+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-16T12:54:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:43.545+0000 7f1293fff640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:43.545+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:43.545+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T12:54:44.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.295+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180335216 0 0) 0x7f12940b6570 con 0x7f12780036e0 2024-04-16T12:54:44.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.295+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1284003520 con 0x7f12780036e0 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.1 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1524542889 0 0) 0x7f1284003520 con 0x7f12780036e0 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 msgr2=0x7f1278009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 --2- 172.21.15.18:0/2715134752 >> v2:172.21.15.104:3300/0 conn(0x7f1278007350 0x7f1278009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127800af70 con 0x7f12780036e0 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.1 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f128800d580 con 0x7f12780036e0 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 >> v1:172.21.15.104:6789/0 conn(0x7f12780036e0 legacy=0x7f1278005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1299157640 1 -- 172.21.15.18:0/2715134752 reap_dead start 2024-04-16T12:54:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 0x7f1284003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f1284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12940b0f20 con 0x7f1284003a00 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f128400c280 con 0x7f1284004800 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f128400c480 con 0x7f12840053c0 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 0x7f1284003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f1284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1299157640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1299157640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 msgr2=0x7f128400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1299157640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 msgr2=0x7f128400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.301+0000 7f1299157640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1299157640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 msgr2=0x7f128400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:44.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 msgr2=0x7f1284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f1284004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 -- 172.21.15.18:0/2715134752 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1284003520 con 0x7f1284003a00 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1293fff640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f1284004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.302+0000 7f1298956640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 0x7f1284003e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1288013410 tx=0x7f1284005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b263ff9cbdffba server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288033070 con 0x7f1284003a00 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128802d650 con 0x7f1284003a00 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f12937fe640 1 -- 172.21.15.18:0/2715134752 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128800ddc0 con 0x7f1284003a00 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f129abba640 1 -- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 msgr2=0x7f1284003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f129abba640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 0x7f1284003e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1288013410 tx=0x7f1284005830 comp rx=0 tx=0).stop 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f129abba640 1 -- 172.21.15.18:0/2715134752 shutdown_connections 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.303+0000 7f129abba640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12840053c0 0x7f128400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.304+0000 7f129abba640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f1284004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.304+0000 7f129abba640 1 --2- 172.21.15.18:0/2715134752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1284003a00 0x7f1284003e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.304+0000 7f129abba640 1 -- 172.21.15.18:0/2715134752 >> 172.21.15.18:0/2715134752 conn(0x7f129409aa10 msgr2=0x7f12940b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.304+0000 7f129abba640 1 -- 172.21.15.18:0/2715134752 shutdown_connections 2024-04-16T12:54:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.304+0000 7f129abba640 1 -- 172.21.15.18:0/2715134752 wait complete. 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.305+0000 7f129abba640 1 Processor -- start 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.305+0000 7f129abba640 1 -- start start 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f12941e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12940b6e10 con 0x7f12840053c0 2024-04-16T12:54:44.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f12940b6b30 con 0x7f1284004800 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f129abba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f12940b3a50 con 0x7f1284003a00 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f1299157640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f1299157640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49304/0 (socket says 172.21.15.18:49304) 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f1299157640 1 -- 172.21.15.18:0/1497102818 learned_addr learned my addr 172.21.15.18:0/1497102818 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f1293fff640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f12941e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.306+0000 7f1298956640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1298956640 1 -- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 msgr2=0x7f1294146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1298956640 1 -- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 msgr2=0x7f1294146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1298956640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1298956640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 -- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 msgr2=0x7f1294146890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 -- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 msgr2=0x7f12941e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:44.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f12941e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 -- 172.21.15.18:0/1497102818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129415e6a0 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1293fff640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f12941e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f1299157640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1278009dd0 tx=0x7f128c0078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c00db10 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128c00dcb0 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129415b6d0 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c013660 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129415ec20 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f128c013800 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.307+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f128c01c9c0 con 0x7f12840053c0 2024-04-16T12:54:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.308+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129415c090 con 0x7f12840053c0 2024-04-16T12:54:44.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.312+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f129415c090 con 0x7f12840053c0 2024-04-16T12:54:44.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.381+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f12940d2130 con 0x7f12840053c0 2024-04-16T12:54:44.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.383+0000 7f12917fa640 1 -- 172.21.15.18:0/1497102818 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f128c00de60 con 0x7f12840053c0 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.383+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 msgr2=0x7f12941e8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.383+0000 7f129abba640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1278009dd0 tx=0x7f128c0078c0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 shutdown_connections 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12840053c0 0x7f12941e8080 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1284004800 0x7f12941e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 --2- 172.21.15.18:0/1497102818 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1284003a00 0x7f1294146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 >> 172.21.15.18:0/1497102818 conn(0x7f129409aa10 msgr2=0x7f12940b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 shutdown_connections 2024-04-16T12:54:44.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:44.384+0000 7f129abba640 1 -- 172.21.15.18:0/1497102818 wait complete. 2024-04-16T12:54:44.396 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T12:54:44.396 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T12:54:44.396 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:44.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T12:54:44.425 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:44.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T12:54:44.494 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:44.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T12:54:44.563 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:54:44.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T12:54:44.631 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:44.631 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T12:54:44.659 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:44.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T12:54:44.728 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:44.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T12:54:44.773 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:44.768+0000 7f3e52844040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T12:54:44.802 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:54:44.802 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T12:54:44.826 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:44.825+0000 7f3e52844040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T12:54:44.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 6d555f91-df2f-4d04-9715-1cc07b5735e3 0 2024-04-16T12:54:44.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.996+0000 7fbb8b214640 1 Processor -- start 2024-04-16T12:54:44.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.996+0000 7fbb8b214640 1 -- start start 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb8b214640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb84162740 0x7fbb84162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb8b214640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb8b214640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8406f170 con 0x7fbb84163060 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb8b214640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbb840706a0 con 0x7fbb84162740 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb8b214640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8406f410 con 0x7fbb84067ff0 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb897b1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.997+0000 7fbb897b1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42660/0 (socket says 172.21.15.104:42660) 2024-04-16T12:54:45.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb897b1640 1 -- 172.21.15.104:0/1129025559 learned_addr learned my addr 172.21.15.104:0/1129025559 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb897b1640 1 -- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb8415f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:45.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb897b1640 1 -- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb8415f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:45.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb897b1640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb897b1640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb88fb0640 1 --2- 172.21.15.104:0/1129025559 >> v2:172.21.15.18:3300/0 conn(0x7fbb84162740 0x7fbb84162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb837fe640 1 -- 172.21.15.104:0/1129025559 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126767453 0 0) 0x7fbb8406f170 con 0x7fbb84163060 2024-04-16T12:54:45.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb837fe640 1 -- 172.21.15.104:0/1129025559 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb74003520 con 0x7fbb84163060 2024-04-16T12:54:45.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb88fb0640 1 -- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb8415f960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:45.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb88fb0640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb88fb0640 1 -- 172.21.15.104:0/1129025559 >> v1:172.21.15.18:6789/0 conn(0x7fbb84163060 legacy=0x7fbb840aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.998+0000 7fbb88fb0640 1 -- 172.21.15.104:0/1129025559 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8406f6f0 con 0x7fbb84162740 2024-04-16T12:54:45.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.999+0000 7fbb88fb0640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb84162b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb780097a0 tx=0x7fbb7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7e0b788650676c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.999+0000 7fbb837fe640 1 -- 172.21.15.104:0/1129025559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78035020 con 0x7fbb84162740 2024-04-16T12:54:45.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.999+0000 7fbb837fe640 1 -- 172.21.15.104:0/1129025559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb78031830 con 0x7fbb84162740 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:44.999+0000 7fbb837fe640 1 -- 172.21.15.104:0/1129025559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78031c00 con 0x7fbb84162740 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 -- 172.21.15.104:0/1129025559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 msgr2=0x7fbb84162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb84162b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb780097a0 tx=0x7fbb7802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 -- 172.21.15.104:0/1129025559 shutdown_connections 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb8415f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 --2- 172.21.15.104:0/1129025559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb84162b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 -- 172.21.15.104:0/1129025559 >> 172.21.15.104:0/1129025559 conn(0x7fbb84073670 msgr2=0x7fbb8406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 -- 172.21.15.104:0/1129025559 shutdown_connections 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.000+0000 7fbb8b214640 1 -- 172.21.15.104:0/1129025559 wait complete. 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.001+0000 7fbb8b214640 1 Processor -- start 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.001+0000 7fbb8b214640 1 -- start start 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb8415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 0x7fbb84148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8406ff90 con 0x7fbb84162740 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8406fcb0 con 0x7fbb84163060 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb8b214640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fbb840af700 con 0x7fbb84067ff0 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42670/0 (socket says 172.21.15.104:42670) 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb897b1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 0x7fbb84148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 -- 172.21.15.104:0/3690599417 learned_addr learned my addr 172.21.15.104:0/3690599417 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 -- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb84159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 -- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb84159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb88fb0640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.002+0000 7fbb83fff640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb8415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 -- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 msgr2=0x7fbb84159b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 -- 172.21.15.104:0/3690599417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 msgr2=0x7fbb8415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb8415cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 -- 172.21.15.104:0/3690599417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8415a240 con 0x7fbb84163060 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb897b1640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 0x7fbb84148780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009fd0 tx=0x7fbb7c007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c01a070 con 0x7fbb84163060 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c00dbe0 con 0x7fbb84163060 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8415aa40 con 0x7fbb84163060 2024-04-16T12:54:45.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c015400 con 0x7fbb84163060 2024-04-16T12:54:45.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8415b000 con 0x7fbb84163060 2024-04-16T12:54:45.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb7c01d070 con 0x7fbb84163060 2024-04-16T12:54:45.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.003+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fbb7c01fbc0 con 0x7fbb84163060 2024-04-16T12:54:45.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.004+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8415b200 con 0x7fbb84163060 2024-04-16T12:54:45.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.006+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbb8415b200 con 0x7fbb84163060 2024-04-16T12:54:45.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.079+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d555f91-df2f-4d04-9715-1cc07b5735e3", "id": 0} v 0) -- 0x7fbb84068a70 con 0x7fbb84163060 2024-04-16T12:54:45.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.084+0000 7fbb817fa640 1 -- 172.21.15.104:0/3690599417 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d555f91-df2f-4d04-9715-1cc07b5735e3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fbb7c024070 con 0x7fbb84163060 2024-04-16T12:54:45.086 INFO:teuthology.orchestra.run.smithi104.stdout:0 2024-04-16T12:54:45.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 msgr2=0x7fbb84148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 0x7fbb84148780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009fd0 tx=0x7fbb7c007ef0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 shutdown_connections 2024-04-16T12:54:45.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb84163060 0x7fbb84148780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb84162740 0x7fbb8415cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 --2- 172.21.15.104:0/3690599417 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbb84067ff0 0x7fbb84159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 >> 172.21.15.104:0/3690599417 conn(0x7fbb84073670 msgr2=0x7fbb84154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 shutdown_connections 2024-04-16T12:54:45.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.085+0000 7fbb8b214640 1 -- 172.21.15.104:0/3690599417 wait complete. 2024-04-16T12:54:45.100 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 980098a4-db6d-4e8d-88a8-44f1c21e8c82 1 2024-04-16T12:54:45.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.201+0000 7f096c331640 1 Processor -- start 2024-04-16T12:54:45.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.201+0000 7f096c331640 1 -- start start 2024-04-16T12:54:45.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096c331640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09640b4940 0x7f096415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096c331640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0964160f40 0x7f096415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096c331640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096415da50 con 0x7f096415c650 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096c331640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0964160460 con 0x7f0964160f40 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096c331640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0964160740 con 0x7f09640b4940 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f09698cc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09640b4940 0x7f096415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f09698cc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09640b4940 0x7f096415ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55696/0 (socket says 172.21.15.104:55696) 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f09698cc640 1 -- 172.21.15.104:0/516224971 learned_addr learned my addr 172.21.15.104:0/516224971 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096a0cd640 1 --1- 172.21.15.104:0/516224971 >> v1:172.21.15.104:6789/0 conn(0x7f096415c650 0x7f09640b4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:48722/0 (socket says 172.21.15.104:48722) 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.202+0000 7f096a8ce640 1 --2- 172.21.15.104:0/516224971 >> v2:172.21.15.18:3300/0 conn(0x7f0964160f40 0x7f096415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.203+0000 7f09698cc640 1 -- 172.21.15.104:0/516224971 >> v2:172.21.15.18:3300/0 conn(0x7f0964160f40 msgr2=0x7f096415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.203+0000 7f09698cc640 1 --2- 172.21.15.104:0/516224971 >> v2:172.21.15.18:3300/0 conn(0x7f0964160f40 0x7f096415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.203+0000 7f09698cc640 1 -- 172.21.15.104:0/516224971 >> v1:172.21.15.104:6789/0 conn(0x7f096415c650 legacy=0x7f09640b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.203+0000 7f09698cc640 1 -- 172.21.15.104:0/516224971 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096415d4b0 con 0x7f09640b4940 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.203+0000 7f09698cc640 1 --2- 172.21.15.104:0/516224971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09640b4940 0x7f096415ca30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0964160240 tx=0x7f095802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe43ec5e41f6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f09690cb640 1 -- 172.21.15.104:0/516224971 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958035020 con 0x7f09640b4940 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f09690cb640 1 -- 172.21.15.104:0/516224971 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958031870 con 0x7f09640b4940 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f09690cb640 1 -- 172.21.15.104:0/516224971 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958031c40 con 0x7f09640b4940 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 -- 172.21.15.104:0/516224971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09640b4940 msgr2=0x7f096415ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 --2- 172.21.15.104:0/516224971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09640b4940 0x7f096415ca30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0964160240 tx=0x7f095802b910 comp rx=0 tx=0).stop 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 -- 172.21.15.104:0/516224971 shutdown_connections 2024-04-16T12:54:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 --2- 172.21.15.104:0/516224971 >> v2:172.21.15.18:3300/0 conn(0x7f0964160f40 0x7f096415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 --2- 172.21.15.104:0/516224971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09640b4940 0x7f096415ca30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 -- 172.21.15.104:0/516224971 >> 172.21.15.104:0/516224971 conn(0x7f096406ed40 msgr2=0x7f096406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 -- 172.21.15.104:0/516224971 shutdown_connections 2024-04-16T12:54:45.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.204+0000 7f096c331640 1 -- 172.21.15.104:0/516224971 wait complete. 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.205+0000 7f096c331640 1 Processor -- start 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.205+0000 7f096c331640 1 -- start start 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09640b4940 0x7f096415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09640c7ae0 con 0x7f09640b4940 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f09640c7960 con 0x7f096415c650 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096c331640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f09640c7c60 con 0x7f0964160f40 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f09698cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f09698cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55704/0 (socket says 172.21.15.104:55704) 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42674/0 (socket says 172.21.15.104:42674) 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f09698cc640 1 -- 172.21.15.104:0/3778605019 learned_addr learned my addr 172.21.15.104:0/3778605019 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a0cd640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09640b4940 0x7f096415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 -- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 msgr2=0x7f0964152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 -- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 msgr2=0x7f0964152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.206+0000 7f096a8ce640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 -- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 msgr2=0x7f0964152060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 -- 172.21.15.104:0/3778605019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09640b4940 msgr2=0x7f096415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09640b4940 0x7f096415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 -- 172.21.15.104:0/3778605019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096415a3b0 con 0x7f096415c650 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f09698cc640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f095802b950 tx=0x7f09580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958040070 con 0x7f096415c650 2024-04-16T12:54:45.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958030d00 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096415a690 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958035040 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096415ac50 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f095804b060 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.207+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f095804d8f0 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.208+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0964068a70 con 0x7f096415c650 2024-04-16T12:54:45.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.210+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0958052020 con 0x7f096415c650 2024-04-16T12:54:45.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.283+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "980098a4-db6d-4e8d-88a8-44f1c21e8c82", "id": 1} v 0) -- 0x7f09640cfe20 con 0x7f096415c650 2024-04-16T12:54:45.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.286+0000 7f0956ffd640 1 -- 172.21.15.104:0/3778605019 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "980098a4-db6d-4e8d-88a8-44f1c21e8c82", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f095803ab60 con 0x7f096415c650 2024-04-16T12:54:45.287 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 msgr2=0x7f096415efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f095802b950 tx=0x7f09580046c0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 shutdown_connections 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0964160f40 0x7f0964152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096415c650 0x7f096415efe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 --2- 172.21.15.104:0/3778605019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09640b4940 0x7f096415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 >> 172.21.15.104:0/3778605019 conn(0x7f096406ed40 msgr2=0x7f09640d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 shutdown_connections 2024-04-16T12:54:45.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.287+0000 7f096c331640 1 -- 172.21.15.104:0/3778605019 wait complete. 2024-04-16T12:54:45.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new dd3f633b-580f-4145-8279-9dda15232ed9 2 2024-04-16T12:54:45.383 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.382+0000 7f3e52844040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T12:54:45.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.402+0000 7f474e709640 1 Processor -- start 2024-04-16T12:54:45.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.402+0000 7f474e709640 1 -- start start 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474e709640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f474806e000 0x7f47480ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474e709640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f47480c4a20 0x7f47480cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474e709640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f474806f630 con 0x7f47480c45c0 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474e709640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f474806f910 con 0x7f47480c4a20 2024-04-16T12:54:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474e709640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f474806fbf0 con 0x7f474806e000 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f474806e000 0x7f47480ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f474806e000 0x7f47480ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55708/0 (socket says 172.21.15.104:55708) 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 -- 172.21.15.104:0/315815747 learned_addr learned my addr 172.21.15.104:0/315815747 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f474cca6640 1 --2- 172.21.15.104:0/315815747 >> v2:172.21.15.18:3300/0 conn(0x7f47480c4a20 0x7f47480cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 -- 172.21.15.104:0/315815747 >> v2:172.21.15.18:3300/0 conn(0x7f47480c4a20 msgr2=0x7f47480cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 --2- 172.21.15.104:0/315815747 >> v2:172.21.15.18:3300/0 conn(0x7f47480c4a20 0x7f47480cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 -- 172.21.15.104:0/315815747 >> v1:172.21.15.18:6789/0 conn(0x7f47480c45c0 legacy=0x7f47480ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.403+0000 7f4747fff640 1 -- 172.21.15.104:0/315815747 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474806fed0 con 0x7f474806e000 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.404+0000 7f4747fff640 1 --2- 172.21.15.104:0/315815747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f47480ce8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f47480d26f0 tx=0x7f473802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491d3ed5999cbbcf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.404+0000 7f4746ffd640 1 -- 172.21.15.104:0/315815747 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738034070 con 0x7f474806e000 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.404+0000 7f4746ffd640 1 -- 172.21.15.104:0/315815747 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738030860 con 0x7f474806e000 2024-04-16T12:54:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.404+0000 7f4746ffd640 1 -- 172.21.15.104:0/315815747 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738030c30 con 0x7f474806e000 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 -- 172.21.15.104:0/315815747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 msgr2=0x7f47480ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 --2- 172.21.15.104:0/315815747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f47480ce8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f47480d26f0 tx=0x7f473802b9a0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 -- 172.21.15.104:0/315815747 shutdown_connections 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 --2- 172.21.15.104:0/315815747 >> v2:172.21.15.18:3300/0 conn(0x7f47480c4a20 0x7f47480cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 --2- 172.21.15.104:0/315815747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f47480ce8f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 -- 172.21.15.104:0/315815747 >> 172.21.15.104:0/315815747 conn(0x7f474809aa10 msgr2=0x7f47480b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 -- 172.21.15.104:0/315815747 shutdown_connections 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.405+0000 7f474e709640 1 -- 172.21.15.104:0/315815747 wait complete. 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.406+0000 7f474e709640 1 Processor -- start 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.406+0000 7f474e709640 1 -- start start 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47480c45c0 0x7f4748166010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f474806f300 con 0x7f47480c45c0 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f47480b3ce0 con 0x7f474806e000 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474e709640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f47480c4e50 con 0x7f47480c4a20 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42688/0 (socket says 172.21.15.104:42688) 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 -- 172.21.15.104:0/3721112841 learned_addr learned my addr 172.21.15.104:0/3721112841 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55712/0 (socket says 172.21.15.104:55712) 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f47477fe640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47480c45c0 0x7f4748166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 -- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 msgr2=0x7f47480c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 -- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 msgr2=0x7f47480c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f474cca6640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 -- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 msgr2=0x7f47480c7280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 -- 172.21.15.104:0/3721112841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47480c45c0 msgr2=0x7f4748166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47480c45c0 0x7f4748166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 -- 172.21.15.104:0/3721112841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47480c61e0 con 0x7f474806e000 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.407+0000 7f4747fff640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4738033000 tx=0x7f4738004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738048070 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4738030660 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738034040 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47480c64c0 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47480c6a80 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4738037070 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.408+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4738043410 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.409+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f474806db40 con 0x7f474806e000 2024-04-16T12:54:45.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.411+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4738030830 con 0x7f474806e000 2024-04-16T12:54:45.441 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.440+0000 7f3e52844040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T12:54:45.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.484+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd3f633b-580f-4145-8279-9dda15232ed9", "id": 2} v 0) -- 0x7f47480b16e0 con 0x7f474806e000 2024-04-16T12:54:45.487 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.486+0000 7f3e52844040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T12:54:45.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.487+0000 7f4744ff9640 1 -- 172.21.15.104:0/3721112841 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd3f633b-580f-4145-8279-9dda15232ed9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f47380436a0 con 0x7f474806e000 2024-04-16T12:54:45.488 INFO:teuthology.orchestra.run.smithi104.stdout:2 2024-04-16T12:54:45.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 msgr2=0x7f474815d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4738033000 tx=0x7f4738004730 comp rx=0 tx=0).stop 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 shutdown_connections 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f47480c4a20 0x7f47480c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47480c45c0 0x7f4748166010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 --2- 172.21.15.104:0/3721112841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f474806e000 0x7f474815d580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 >> 172.21.15.104:0/3721112841 conn(0x7f474809aa10 msgr2=0x7f47480b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 shutdown_connections 2024-04-16T12:54:45.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.488+0000 7f474e709640 1 -- 172.21.15.104:0/3721112841 wait complete. 2024-04-16T12:54:45.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a 3 2024-04-16T12:54:45.548 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.545+0000 7f3e52844040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T12:54:45.588 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:45.587+0000 7f59a583b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T12:54:45.590 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.589+0000 7f3e52844040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T12:54:45.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.602+0000 7f284a00d640 1 Processor -- start 2024-04-16T12:54:45.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.602+0000 7f284a00d640 1 -- start start 2024-04-16T12:54:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f284415b8e0 0x7f284406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f284406d740 0x7f28440cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f28440cea20 con 0x7f284415b8e0 2024-04-16T12:54:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f28440ced00 con 0x7f284406d740 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f284a00d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2844070d20 con 0x7f284406e290 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f284406d740 0x7f28440cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f284406d740 0x7f28440cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55728/0 (socket says 172.21.15.104:55728) 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42694/0 (socket says 172.21.15.104:42694) 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 -- 172.21.15.104:0/473388141 learned_addr learned my addr 172.21.15.104:0/473388141 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f28437fe640 1 --2- 172.21.15.104:0/473388141 >> v2:172.21.15.18:3300/0 conn(0x7f284415b8e0 0x7f284406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 -- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 msgr2=0x7f284406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 -- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 msgr2=0x7f284406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f2843fff640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 -- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 msgr2=0x7f284406cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 -- 172.21.15.104:0/473388141 >> v2:172.21.15.18:3300/0 conn(0x7f284415b8e0 msgr2=0x7f284406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 --2- 172.21.15.104:0/473388141 >> v2:172.21.15.18:3300/0 conn(0x7f284415b8e0 0x7f284406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.603+0000 7f283affd640 1 -- 172.21.15.104:0/473388141 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2844070940 con 0x7f284406d740 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.604+0000 7f283affd640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284406d740 0x7f28440cf1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f28440729c0 tx=0x7f282c02db20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c767bfc1bb20cf76 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.604+0000 7f2842ffd640 1 -- 172.21.15.104:0/473388141 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c02f8e0 con 0x7f284406d740 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.604+0000 7f2842ffd640 1 -- 172.21.15.104:0/473388141 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c02fa80 con 0x7f284406d740 2024-04-16T12:54:45.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.604+0000 7f2842ffd640 1 -- 172.21.15.104:0/473388141 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c02fe50 con 0x7f284406d740 2024-04-16T12:54:45.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 -- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284406d740 msgr2=0x7f28440cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284406d740 0x7f28440cf1c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f28440729c0 tx=0x7f282c02db20 comp rx=0 tx=0).stop 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 -- 172.21.15.104:0/473388141 shutdown_connections 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284406d740 0x7f28440cf1c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 --2- 172.21.15.104:0/473388141 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406e290 0x7f284406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 --2- 172.21.15.104:0/473388141 >> v2:172.21.15.18:3300/0 conn(0x7f284415b8e0 0x7f284406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 -- 172.21.15.104:0/473388141 >> 172.21.15.104:0/473388141 conn(0x7f284409aa10 msgr2=0x7f28440b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 -- 172.21.15.104:0/473388141 shutdown_connections 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.605+0000 7f284a00d640 1 -- 172.21.15.104:0/473388141 wait complete. 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.606+0000 7f284a00d640 1 Processor -- start 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.606+0000 7f284a00d640 1 -- start start 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f284406e290 0x7f28440caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 0x7f28440b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b3a10 con 0x7f284406e290 2024-04-16T12:54:45.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b3890 con 0x7f284415b8e0 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f284a00d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f284406f0f0 con 0x7f284406d740 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 0x7f28440b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42702/0 (socket says 172.21.15.104:42702) 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 -- 172.21.15.104:0/483480837 learned_addr learned my addr 172.21.15.104:0/483480837 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f283affd640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f284406e290 0x7f28440caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 -- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 msgr2=0x7f28440c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 -- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 msgr2=0x7f28440c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f28437fe640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 -- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 msgr2=0x7f28440c78a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 -- 172.21.15.104:0/483480837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f284406e290 msgr2=0x7f28440caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f284406e290 0x7f28440caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 -- 172.21.15.104:0/483480837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440c9e30 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.607+0000 7f2843fff640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 0x7f28440b20c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f283c009610 tx=0x7f283c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c014420 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c019070 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28440ca110 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c014800 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28440ca6d0 con 0x7f284415b8e0 2024-04-16T12:54:45.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f283c0149a0 con 0x7f284415b8e0 2024-04-16T12:54:45.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.608+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f283c01eda0 con 0x7f284415b8e0 2024-04-16T12:54:45.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.609+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2844068a70 con 0x7f284415b8e0 2024-04-16T12:54:45.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.611+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f283c01d3c0 con 0x7f284415b8e0 2024-04-16T12:54:45.644 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:45.643+0000 7f59a583b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T12:54:45.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.681+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a", "id": 3} v 0) -- 0x7f2844073280 con 0x7f284415b8e0 2024-04-16T12:54:45.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.684+0000 7f2840ff9640 1 -- 172.21.15.104:0/483480837 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f283c01e460 con 0x7f284415b8e0 2024-04-16T12:54:45.686 INFO:teuthology.orchestra.run.smithi104.stdout:3 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 msgr2=0x7f28440b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 0x7f28440b20c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f283c009610 tx=0x7f283c00e4b0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 shutdown_connections 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f284415b8e0 0x7f28440b20c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f284406e290 0x7f28440caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 --2- 172.21.15.104:0/483480837 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f284406d740 0x7f28440c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.685+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 >> 172.21.15.104:0/483480837 conn(0x7f284409aa10 msgr2=0x7f284406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.686+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 shutdown_connections 2024-04-16T12:54:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.686+0000 7f284a00d640 1 -- 172.21.15.104:0/483480837 wait complete. 2024-04-16T12:54:45.697 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new e659340c-01fe-42b0-84df-5e492bbe2111 4 2024-04-16T12:54:45.715 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.712+0000 7f3e52844040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T12:54:45.787 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.786+0000 7f3e52844040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.799+0000 7f467a982640 1 Processor -- start 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.799+0000 7f467a982640 1 -- start start 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f467a982640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46740b4940 0x7f467415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f467a982640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467415da50 con 0x7f4674160f40 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f467a982640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4674160460 con 0x7f467415c650 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f467a982640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f4674160740 con 0x7f46740b4940 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f46737fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46740b4940 0x7f467415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f4673fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f467415c650 0x7f46740b4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:48736/0 (socket says 172.21.15.104:48736) 2024-04-16T12:54:45.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.800+0000 7f4673fff640 1 -- 172.21.15.104:0/244734305 learned_addr learned my addr 172.21.15.104:0/244734305 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-16T12:54:45.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.801+0000 7f46737fe640 1 -- 172.21.15.104:0/244734305 >> v1:172.21.15.104:6789/0 conn(0x7f467415c650 legacy=0x7f46740b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.801+0000 7f46737fe640 1 -- 172.21.15.104:0/244734305 >> v1:172.21.15.18:6789/0 conn(0x7f4674160f40 legacy=0x7f467415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.801+0000 7f4672ffd640 1 -- 172.21.15.104:0/244734305 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729070445 0 0) 0x7f4674160460 con 0x7f467415c650 2024-04-16T12:54:45.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.801+0000 7f46737fe640 1 -- 172.21.15.104:0/244734305 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467415d680 con 0x7f46740b4940 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.801+0000 7f46737fe640 1 --2- 172.21.15.104:0/244734305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f467415ca30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f46640097a0 tx=0x7f466402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43a46c24b106fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f4672ffd640 1 -- 172.21.15.104:0/244734305 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664035020 con 0x7f46740b4940 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f4672ffd640 1 -- 172.21.15.104:0/244734305 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4664031830 con 0x7f46740b4940 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f4672ffd640 1 -- 172.21.15.104:0/244734305 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664031c00 con 0x7f46740b4940 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 -- 172.21.15.104:0/244734305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 msgr2=0x7f467415ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 --2- 172.21.15.104:0/244734305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f467415ca30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f46640097a0 tx=0x7f466402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 -- 172.21.15.104:0/244734305 shutdown_connections 2024-04-16T12:54:45.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 --2- 172.21.15.104:0/244734305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f467415ca30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 -- 172.21.15.104:0/244734305 >> 172.21.15.104:0/244734305 conn(0x7f467406ed40 msgr2=0x7f467406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 -- 172.21.15.104:0/244734305 shutdown_connections 2024-04-16T12:54:45.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.802+0000 7f467a982640 1 -- 172.21.15.104:0/244734305 wait complete. 2024-04-16T12:54:45.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.804+0000 7f467a982640 1 Processor -- start 2024-04-16T12:54:45.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.804+0000 7f467a982640 1 -- start start 2024-04-16T12:54:45.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4674160f40 0x7f4674158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:45.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4674167a00 con 0x7f4674160f40 2024-04-16T12:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4674167880 con 0x7f46740b4940 2024-04-16T12:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.805+0000 7f467a982640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4674167b80 con 0x7f467415c650 2024-04-16T12:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55754/0 (socket says 172.21.15.104:55754) 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42716/0 (socket says 172.21.15.104:42716) 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 -- 172.21.15.104:0/1674891429 learned_addr learned my addr 172.21.15.104:0/1674891429 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 -- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 msgr2=0x7f4674150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4678f1f640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4674160f40 0x7f4674158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 -- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 msgr2=0x7f4674150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f46737fe640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 -- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 msgr2=0x7f4674150730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 -- 172.21.15.104:0/1674891429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4674160f40 msgr2=0x7f4674158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4674160f40 0x7f4674158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 -- 172.21.15.104:0/1674891429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46740b6290 con 0x7f46740b4940 2024-04-16T12:54:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4673fff640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c4d0 tx=0x7f465c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c018070 con 0x7f46740b4940 2024-04-16T12:54:45.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c0074e0 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c004a20 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46740b6570 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4674159190 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f465c01b070 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.806+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f465c012910 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.807+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4674068a70 con 0x7f46740b4940 2024-04-16T12:54:45.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.809+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f465c012b60 con 0x7f46740b4940 2024-04-16T12:54:45.837 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.836+0000 7f3e52844040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T12:54:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.882+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e659340c-01fe-42b0-84df-5e492bbe2111", "id": 4} v 0) -- 0x7f46740d05e0 con 0x7f46740b4940 2024-04-16T12:54:45.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.885+0000 7f4670ff9640 1 -- 172.21.15.104:0/1674891429 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e659340c-01fe-42b0-84df-5e492bbe2111", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f465c004bc0 con 0x7f46740b4940 2024-04-16T12:54:45.887 INFO:teuthology.orchestra.run.smithi104.stdout:4 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 msgr2=0x7f46741532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c4d0 tx=0x7f465c00c990 comp rx=0 tx=0).stop 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 shutdown_connections 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4674160f40 0x7f4674158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f467415c650 0x7f4674150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 --2- 172.21.15.104:0/1674891429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46740b4940 0x7f46741532a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.886+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 >> 172.21.15.104:0/1674891429 conn(0x7f467406ed40 msgr2=0x7f46740c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:45.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.887+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 shutdown_connections 2024-04-16T12:54:45.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:45.887+0000 7f467a982640 1 -- 172.21.15.104:0/1674891429 wait complete. 2024-04-16T12:54:45.896 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.891+0000 7f3e52844040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T12:54:45.898 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 1c6857ea-bf9a-4fc8-841e-b96992e7671d 5 2024-04-16T12:54:45.950 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:45.940+0000 7f3e52844040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T12:54:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.040+0000 7fe50da88640 1 Processor -- start 2024-04-16T12:54:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.040+0000 7fe50da88640 1 -- start start 2024-04-16T12:54:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe50da88640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5080d0af0 0x7fe5080ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe50da88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe50da88640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5080b7020 con 0x7fe5080ce4d0 2024-04-16T12:54:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe50da88640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe5081605c0 con 0x7fe5080d0af0 2024-04-16T12:54:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe50da88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe508160e60 con 0x7fe5080ceca0 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42732/0 (socket says 172.21.15.104:42732) 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 -- 172.21.15.104:0/185976398 learned_addr learned my addr 172.21.15.104:0/185976398 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 -- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 msgr2=0x7fe5080cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 -- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 msgr2=0x7fe5080cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe4feffd640 1 --2- 172.21.15.104:0/185976398 >> v2:172.21.15.18:3300/0 conn(0x7fe5080d0af0 0x7fe5080ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe507fff640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe506ffd640 1 -- 172.21.15.104:0/185976398 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260582845 0 0) 0x7fe5080b7020 con 0x7fe5080ce4d0 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe506ffd640 1 -- 172.21.15.104:0/185976398 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f4003520 con 0x7fe5080ce4d0 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe4feffd640 1 -- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 msgr2=0x7fe5080cd1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe4feffd640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.041+0000 7fe4feffd640 1 -- 172.21.15.104:0/185976398 >> v1:172.21.15.18:6789/0 conn(0x7fe5080ce4d0 legacy=0x7fe5080d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.042+0000 7fe4feffd640 1 -- 172.21.15.104:0/185976398 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe508160810 con 0x7fe5080d0af0 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe4feffd640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080d0af0 0x7fe5080ccc80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c29b7f8dd34edb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe506ffd640 1 -- 172.21.15.104:0/185976398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0035020 con 0x7fe5080d0af0 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe506ffd640 1 -- 172.21.15.104:0/185976398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f0031830 con 0x7fe5080d0af0 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe506ffd640 1 -- 172.21.15.104:0/185976398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0031c00 con 0x7fe5080d0af0 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe50da88640 1 -- 172.21.15.104:0/185976398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080d0af0 msgr2=0x7fe5080ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.043+0000 7fe50da88640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080d0af0 0x7fe5080ccc80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002b8d0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 -- 172.21.15.104:0/185976398 shutdown_connections 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ceca0 0x7fe5080cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 --2- 172.21.15.104:0/185976398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080d0af0 0x7fe5080ccc80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 -- 172.21.15.104:0/185976398 >> 172.21.15.104:0/185976398 conn(0x7fe50809aa10 msgr2=0x7fe5080b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 -- 172.21.15.104:0/185976398 shutdown_connections 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.044+0000 7fe50da88640 1 -- 172.21.15.104:0/185976398 wait complete. 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.045+0000 7fe50da88640 1 Processor -- start 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.045+0000 7fe50da88640 1 -- start start 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 0x7fe5081f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 0x7fe50806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5081612f0 con 0x7fe5080ceca0 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe5080b6c50 con 0x7fe5080d0af0 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe5081f3570 con 0x7fe5080ce4d0 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42736/0 (socket says 172.21.15.104:42736) 2024-04-16T12:54:46.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 -- 172.21.15.104:0/3956146955 learned_addr learned my addr 172.21.15.104:0/3956146955 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 0x7fe50806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe4feffd640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 0x7fe5081f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 -- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 msgr2=0x7fe50815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 -- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 msgr2=0x7fe50815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe5077fe640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 -- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 msgr2=0x7fe50815d350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 -- 172.21.15.104:0/3956146955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 msgr2=0x7fe5081f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 0x7fe5081f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 -- 172.21.15.104:0/3956146955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5081f2a50 con 0x7fe5080d0af0 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe4feffd640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 0x7fe5081f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe507fff640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 0x7fe50806ce70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe5080cf0f0 tx=0x7fe500007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50001a070 con 0x7fe5080d0af0 2024-04-16T12:54:46.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50000dbb0 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5081f2cd0 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.046+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500015400 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.047+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5081f3290 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.047+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5000155a0 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.047+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe500014920 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.047+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe508068a70 con 0x7fe5080d0af0 2024-04-16T12:54:46.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.049+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe500023080 con 0x7fe5080d0af0 2024-04-16T12:54:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.122+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c6857ea-bf9a-4fc8-841e-b96992e7671d", "id": 5} v 0) -- 0x7fe5080b7550 con 0x7fe5080d0af0 2024-04-16T12:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.125+0000 7fe504ff9640 1 -- 172.21.15.104:0/3956146955 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c6857ea-bf9a-4fc8-841e-b96992e7671d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe5081f2a50 con 0x7fe5080d0af0 2024-04-16T12:54:46.127 INFO:teuthology.orchestra.run.smithi104.stdout:5 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 msgr2=0x7fe50806ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 0x7fe50806ce70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe5080cf0f0 tx=0x7fe500007ef0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 shutdown_connections 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5080d0af0 0x7fe50806ce70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5080ceca0 0x7fe5081f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 --2- 172.21.15.104:0/3956146955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe5080ce4d0 0x7fe50815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 >> 172.21.15.104:0/3956146955 conn(0x7fe50809aa10 msgr2=0x7fe5080cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 shutdown_connections 2024-04-16T12:54:46.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.126+0000 7fe50da88640 1 -- 172.21.15.104:0/3956146955 wait complete. 2024-04-16T12:54:46.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 30376c5e-4dd9-4056-86fd-33a9aad15a8a 6 2024-04-16T12:54:46.210 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.209+0000 7f59a583b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T12:54:46.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.240+0000 7fc1eb0c8640 1 Processor -- start 2024-04-16T12:54:46.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.240+0000 7fc1eb0c8640 1 -- start start 2024-04-16T12:54:46.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1eb0c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc1e4070580 0x7fc1e40b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1eb0c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e40b6290 con 0x7fc1e4070960 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1eb0c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e40b6570 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1eb0c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e40b0f20 con 0x7fc1e4070580 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1e8e64640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc1e4070580 0x7fc1e40b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1e3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc1e40ae3f0 0x7fc1e40cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:48746/0 (socket says 172.21.15.104:48746) 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.241+0000 7fc1e3fff640 1 -- 172.21.15.104:0/4027000781 learned_addr learned my addr 172.21.15.104:0/4027000781 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.242+0000 7fc1e8e64640 1 -- 172.21.15.104:0/4027000781 >> v1:172.21.15.104:6789/0 conn(0x7fc1e40ae3f0 legacy=0x7fc1e40cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.242+0000 7fc1e8e64640 1 -- 172.21.15.104:0/4027000781 >> v1:172.21.15.18:6789/0 conn(0x7fc1e4070960 legacy=0x7fc1e40d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.242+0000 7fc1e8e64640 1 -- 172.21.15.104:0/4027000781 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e40b6850 con 0x7fc1e4070580 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.242+0000 7fc1e37fe640 1 -- 172.21.15.104:0/4027000781 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034371611 0 0) 0x7fc1e40b6570 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.242+0000 7fc1e8e64640 1 --2- 172.21.15.104:0/4027000781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4070580 0x7fc1e40b09e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80097a0 tx=0x7fc1d802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3b947f6636ec70 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1e37fe640 1 -- 172.21.15.104:0/4027000781 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8034070 con 0x7fc1e4070580 2024-04-16T12:54:46.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1e37fe640 1 -- 172.21.15.104:0/4027000781 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d8030610 con 0x7fc1e4070580 2024-04-16T12:54:46.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1e37fe640 1 -- 172.21.15.104:0/4027000781 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80309e0 con 0x7fc1e4070580 2024-04-16T12:54:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/4027000781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4070580 msgr2=0x7fc1e40b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/4027000781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4070580 0x7fc1e40b09e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80097a0 tx=0x7fc1d802b960 comp rx=0 tx=0).stop 2024-04-16T12:54:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/4027000781 shutdown_connections 2024-04-16T12:54:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/4027000781 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e4070580 0x7fc1e40b09e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/4027000781 >> 172.21.15.104:0/4027000781 conn(0x7fc1e409aa10 msgr2=0x7fc1e40b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/4027000781 shutdown_connections 2024-04-16T12:54:46.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.243+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/4027000781 wait complete. 2024-04-16T12:54:46.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.244+0000 7fc1eb0c8640 1 Processor -- start 2024-04-16T12:54:46.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 -- start start 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4070580 0x7fc1e41524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40b6e10 con 0x7fc1e4070580 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40b7180 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.245+0000 7fc1eb0c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e40b3a50 con 0x7fc1e4070960 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55776/0 (socket says 172.21.15.104:55776) 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42750/0 (socket says 172.21.15.104:42750) 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 -- 172.21.15.104:0/2830207754 learned_addr learned my addr 172.21.15.104:0/2830207754 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e8e64640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4070580 0x7fc1e41524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 -- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 msgr2=0x7fc1e41538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 -- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 msgr2=0x7fc1e41538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e3fff640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 -- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 msgr2=0x7fc1e41538e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 -- 172.21.15.104:0/2830207754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4070580 msgr2=0x7fc1e41524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4070580 0x7fc1e41524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 -- 172.21.15.104:0/2830207754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4159ff0 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e9665640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c7d0 tx=0x7fc1dc00cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc003b70 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc003d30 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e4152b20 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00aa30 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41530e0 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1dc00abd0 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.246+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc1dc012ba0 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.247+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4068a70 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.249+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc1dc0125b0 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.267 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.266+0000 7f59a583b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T12:54:46.315 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.314+0000 7f59a583b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T12:54:46.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.322+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30376c5e-4dd9-4056-86fd-33a9aad15a8a", "id": 6} v 0) -- 0x7fc1e4153e20 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.328+0000 7fc1e17fa640 1 -- 172.21.15.104:0/2830207754 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30376c5e-4dd9-4056-86fd-33a9aad15a8a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc1dc012790 con 0x7fc1e40ae3f0 2024-04-16T12:54:46.330 INFO:teuthology.orchestra.run.smithi104.stdout:6 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 msgr2=0x7fc1e4159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c7d0 tx=0x7fc1dc00cc90 comp rx=0 tx=0).stop 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 shutdown_connections 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1e40ae3f0 0x7fc1e4159610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc1e4070960 0x7fc1e41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 --2- 172.21.15.104:0/2830207754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e4070580 0x7fc1e41524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 >> 172.21.15.104:0/2830207754 conn(0x7fc1e409aa10 msgr2=0x7fc1e40afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 shutdown_connections 2024-04-16T12:54:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.329+0000 7fc1eb0c8640 1 -- 172.21.15.104:0/2830207754 wait complete. 2024-04-16T12:54:46.342 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd new 1216dae0-820d-46ca-b883-0c8a56bba17c 7 2024-04-16T12:54:46.344 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.343+0000 7f3e52844040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T12:54:46.372 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.371+0000 7f59a583b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T12:54:46.416 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.415+0000 7f59a583b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T12:54:46.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.443+0000 7ff75fb75640 1 Processor -- start 2024-04-16T12:54:46.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.443+0000 7ff75fb75640 1 -- start start 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75fb75640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75fb75640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff758067ff0 0x7ff75815f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75fb75640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75806f170 con 0x7ff758163060 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75fb75640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff7580706a0 con 0x7ff758067ff0 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75fb75640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff75806f410 con 0x7ff758162740 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75d110640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff758163060 0x7ff7580aeff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:48750/0 (socket says 172.21.15.104:48750) 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75d911640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.444+0000 7ff75d110640 1 -- 172.21.15.104:0/1093525690 learned_addr learned my addr 172.21.15.104:0/1093525690 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75e112640 1 --2- 172.21.15.104:0/1093525690 >> v2:172.21.15.18:3300/0 conn(0x7ff758067ff0 0x7ff75815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75d911640 1 -- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 msgr2=0x7ff758162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75d911640 1 -- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 msgr2=0x7ff758162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75d911640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75d911640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460216169 0 0) 0x7ff75806f170 con 0x7ff758163060 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff744003520 con 0x7ff758163060 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75e112640 1 -- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 msgr2=0x7ff758162b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75e112640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75e112640 1 -- 172.21.15.104:0/1093525690 >> v1:172.21.15.104:6789/0 conn(0x7ff758163060 legacy=0x7ff7580aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 <== mon.1 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928664502 0 0) 0x7ff744003520 con 0x7ff758163060 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.445+0000 7ff75e112640 1 -- 172.21.15.104:0/1093525690 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75806f6f0 con 0x7ff758067ff0 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75e112640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff75815f960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff750009d90 tx=0x7ff75002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a60618cf1c9c3a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff750039070 con 0x7ff758067ff0 2024-04-16T12:54:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75002c8a0 con 0x7ff758067ff0 2024-04-16T12:54:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75c90f640 1 -- 172.21.15.104:0/1093525690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754001670 con 0x7ff758067ff0 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75fb75640 1 -- 172.21.15.104:0/1093525690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 msgr2=0x7ff75815f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.446+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff75815f960 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff750009d90 tx=0x7ff75002bd70 comp rx=0 tx=0).stop 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 -- 172.21.15.104:0/1093525690 shutdown_connections 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff75815f960 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1093525690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758162740 0x7ff758162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 -- 172.21.15.104:0/1093525690 >> 172.21.15.104:0/1093525690 conn(0x7ff758073670 msgr2=0x7ff75806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 -- 172.21.15.104:0/1093525690 shutdown_connections 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.447+0000 7ff75fb75640 1 -- 172.21.15.104:0/1093525690 wait complete. 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.448+0000 7ff75fb75640 1 Processor -- start 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.448+0000 7ff75fb75640 1 -- start start 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.448+0000 7ff75fb75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff7580cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.448+0000 7ff75fb75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 0x7ff758158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.448+0000 7ff75fb75640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75fb75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff75806ff90 con 0x7ff758067ff0 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75fb75640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff75806fcb0 con 0x7ff758162740 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75fb75640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff7580af700 con 0x7ff758163060 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 0x7ff758158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.104:42762/0 (socket says 172.21.15.104:42762) 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 -- 172.21.15.104:0/1690851516 learned_addr learned my addr 172.21.15.104:0/1690851516 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d911640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff7580cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 -- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 msgr2=0x7ff7580b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 -- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 msgr2=0x7ff7580b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75e112640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 -- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 msgr2=0x7ff7580b0f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 -- 172.21.15.104:0/1690851516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 msgr2=0x7ff7580cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff7580cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 -- 172.21.15.104:0/1690851516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff758155d70 con 0x7ff758162740 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d911640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff7580cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75d110640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 0x7ff758158270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff75400cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754017070 con 0x7ff758162740 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff754005ad0 con 0x7ff758162740 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754007070 con 0x7ff758162740 2024-04-16T12:54:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff758155a90 con 0x7ff758162740 2024-04-16T12:54:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.449+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75815d770 con 0x7ff758162740 2024-04-16T12:54:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.450+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff75401a070 con 0x7ff758162740 2024-04-16T12:54:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.450+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff75400ab60 con 0x7ff758162740 2024-04-16T12:54:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.450+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75815eff0 con 0x7ff758162740 2024-04-16T12:54:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.452+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff754021070 con 0x7ff758162740 2024-04-16T12:54:46.486 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.485+0000 7f3e52844040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T12:54:46.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.525+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1216dae0-820d-46ca-b883-0c8a56bba17c", "id": 7} v 0) -- 0x7ff758068a70 con 0x7ff758162740 2024-04-16T12:54:46.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.530+0000 7ff74a7fc640 1 -- 172.21.15.104:0/1690851516 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1216dae0-820d-46ca-b883-0c8a56bba17c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff75400a610 con 0x7ff758162740 2024-04-16T12:54:46.532 INFO:teuthology.orchestra.run.smithi104.stdout:7 2024-04-16T12:54:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 msgr2=0x7ff758158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 0x7ff758158270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff75400cbe0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 shutdown_connections 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff758163060 0x7ff7580b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff758162740 0x7ff758158270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 --2- 172.21.15.104:0/1690851516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff758067ff0 0x7ff7580cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 >> 172.21.15.104:0/1690851516 conn(0x7ff758073670 msgr2=0x7ff7580b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 shutdown_connections 2024-04-16T12:54:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:54:46.531+0000 7ff75fb75640 1 -- 172.21.15.104:0/1690851516 wait complete. 2024-04-16T12:54:46.539 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.538+0000 7f59a583b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T12:54:46.543 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T12:54:46.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T12:54:46.547 INFO:tasks.ceph.osd.0:Started 2024-04-16T12:54:46.547 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T12:54:46.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T12:54:46.552 INFO:tasks.ceph.osd.1:Started 2024-04-16T12:54:46.552 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T12:54:46.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T12:54:46.555 INFO:tasks.ceph.osd.2:Started 2024-04-16T12:54:46.555 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T12:54:46.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T12:54:46.558 INFO:tasks.ceph.osd.3:Started 2024-04-16T12:54:46.558 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T12:54:46.559 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T12:54:46.561 INFO:tasks.ceph.osd.4:Started 2024-04-16T12:54:46.561 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T12:54:46.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T12:54:46.564 INFO:tasks.ceph.osd.5:Started 2024-04-16T12:54:46.564 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T12:54:46.564 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T12:54:46.566 INFO:tasks.ceph.osd.6:Started 2024-04-16T12:54:46.566 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T12:54:46.566 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T12:54:46.569 INFO:tasks.ceph.osd.7:Started 2024-04-16T12:54:46.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:54:46.616 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.615+0000 7f3e52844040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T12:54:46.653 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.651+0000 7f59a583b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T12:54:46.672 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.671+0000 7f3e52844040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T12:54:46.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.696+0000 7f369ac7e640 1 Processor -- start 2024-04-16T12:54:46.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.697+0000 7f369ac7e640 1 -- start start 2024-04-16T12:54:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.697+0000 7f369ac7e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.697+0000 7f369ac7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f36940b48c0 0x7f36940d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f3698a1a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f3698a1a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49344/0 (socket says 172.21.15.18:49344) 2024-04-16T12:54:46.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f3698a1a640 1 -- 172.21.15.18:0/1419636319 learned_addr learned my addr 172.21.15.18:0/1419636319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369415cc00 con 0x7f36940ccd80 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369921b640 1 --2- 172.21.15.18:0/1419636319 >> v2:172.21.15.104:3300/0 conn(0x7f36940b48c0 0x7f36940d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3694160a30 con 0x7f369415c820 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3694160d10 con 0x7f36940b48c0 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f36937fe640 1 -- 172.21.15.18:0/1419636319 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361524452 0 0) 0x7f369415cc00 con 0x7f36940ccd80 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f36937fe640 1 -- 172.21.15.18:0/1419636319 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3684003520 con 0x7f36940ccd80 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369921b640 1 -- 172.21.15.18:0/1419636319 >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 msgr2=0x7f36941603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369921b640 1 --2- 172.21.15.18:0/1419636319 >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369921b640 1 -- 172.21.15.18:0/1419636319 >> v1:172.21.15.104:6789/0 conn(0x7f36940ccd80 legacy=0x7f36940b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f369921b640 1 -- 172.21.15.18:0/1419636319 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3694160ff0 con 0x7f36940b48c0 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.698+0000 7f3698a1a640 1 --2- 172.21.15.18:0/1419636319 >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.699+0000 7f369921b640 1 --2- 172.21.15.18:0/1419636319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940d08c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36940b8690 tx=0x7f368c02bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694e93b7264f0c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.699+0000 7f36937fe640 1 -- 172.21.15.18:0/1419636319 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c039070 con 0x7f36940b48c0 2024-04-16T12:54:46.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.699+0000 7f36937fe640 1 -- 172.21.15.18:0/1419636319 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c02cb60 con 0x7f36940b48c0 2024-04-16T12:54:46.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.699+0000 7f36937fe640 1 -- 172.21.15.18:0/1419636319 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c034440 con 0x7f36940b48c0 2024-04-16T12:54:46.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 msgr2=0x7f36940d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 --2- 172.21.15.18:0/1419636319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940d08c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36940b8690 tx=0x7f368c02bdb0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 shutdown_connections 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 --2- 172.21.15.18:0/1419636319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940d08c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 --2- 172.21.15.18:0/1419636319 >> v2:172.21.15.18:3300/0 conn(0x7f369415c820 0x7f36941603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 >> 172.21.15.18:0/1419636319 conn(0x7f36940cf1b0 msgr2=0x7f36940cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 shutdown_connections 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.700+0000 7f369ac7e640 1 -- 172.21.15.18:0/1419636319 wait complete. 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.701+0000 7f369ac7e640 1 Processor -- start 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.701+0000 7f369ac7e640 1 -- start start 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36940d0e00 con 0x7f369415c820 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f36940b8260 con 0x7f36940b48c0 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369ac7e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f36940d0f80 con 0x7f36940ccd80 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369921b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369921b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49358/0 (socket says 172.21.15.18:49358) 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369921b640 1 -- 172.21.15.18:0/4045185193 learned_addr learned my addr 172.21.15.18:0/4045185193 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3693fff640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3693fff640 1 -- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 msgr2=0x7f36940a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3693fff640 1 -- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 msgr2=0x7f36940a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3693fff640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3693fff640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 -- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 msgr2=0x7f36940a9920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 -- 172.21.15.18:0/4045185193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 msgr2=0x7f36941f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 -- 172.21.15.18:0/4045185193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36940ca9b0 con 0x7f36940b48c0 2024-04-16T12:54:46.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f369921b640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.702+0000 7f3698a1a640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940ca160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f368800e860 tx=0x7f368800ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688004030 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36880041d0 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368800c940 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36940cac90 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36940cb250 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3688003610 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.703+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f36880093b0 con 0x7f36940b48c0 2024-04-16T12:54:46.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.704+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3694068a70 con 0x7f36940b48c0 2024-04-16T12:54:46.715 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.704+0000 7f59a583b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T12:54:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.706+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3688017020 con 0x7f36940b48c0 2024-04-16T12:54:46.761 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.760+0000 7f59a583b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T12:54:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.768+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36940cff70 con 0x7f36940b48c0 2024-04-16T12:54:46.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.769+0000 7f36917fa640 1 -- 172.21.15.18:0/4045185193 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3688013470 con 0x7f36940b48c0 2024-04-16T12:54:46.770 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:54:46.770 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:46.526526+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:54:46.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 msgr2=0x7f36940ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:46.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940ca160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f368800e860 tx=0x7f368800ed20 comp rx=0 tx=0).stop 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 shutdown_connections 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415c820 0x7f36941f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36940ccd80 0x7f36940a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 --2- 172.21.15.18:0/4045185193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36940b48c0 0x7f36940ca160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 >> 172.21.15.18:0/4045185193 conn(0x7f36940cf1b0 msgr2=0x7f36940d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 shutdown_connections 2024-04-16T12:54:46.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:54:46.770+0000 7f369ac7e640 1 -- 172.21.15.18:0/4045185193 wait complete. 2024-04-16T12:54:46.782 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T12:54:46.782 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T12:54:46.787 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.786+0000 7f3e52844040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:54:46.811 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:46.810+0000 7f59a583b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T12:54:46.880 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:46.879+0000 7f3e52844040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T12:54:47.036 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:47.035+0000 7f3e52844040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:54:47.078 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:47.077+0000 7f3e52844040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T12:54:47.172 INFO:tasks.ceph.osd.4.smithi104.stderr:2024-04-16T12:54:47.164+0000 7f7707811640 -1 Falling back to public interface 2024-04-16T12:54:47.172 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-16T12:54:47.163+0000 7fbf2bec1640 -1 Falling back to public interface 2024-04-16T12:54:47.172 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-16T12:54:47.165+0000 7fa2f052a640 -1 Falling back to public interface 2024-04-16T12:54:47.176 INFO:tasks.ceph.osd.6.smithi104.stderr:2024-04-16T12:54:47.174+0000 7f816cf14640 -1 Falling back to public interface 2024-04-16T12:54:47.176 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-16T12:54:47.175+0000 7f0f298a6640 -1 Falling back to public interface 2024-04-16T12:54:47.177 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-16T12:54:47.176+0000 7f312c40e640 -1 Falling back to public interface 2024-04-16T12:54:47.192 INFO:tasks.ceph.osd.5.smithi104.stderr:2024-04-16T12:54:47.186+0000 7fbba92b5640 -1 Falling back to public interface 2024-04-16T12:54:47.195 INFO:tasks.ceph.osd.7.smithi104.stderr:2024-04-16T12:54:47.194+0000 7fcd1f00e640 -1 Falling back to public interface 2024-04-16T12:54:47.212 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.211+0000 7f59a583b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T12:54:47.239 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:47.236+0000 7f3e52844040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T12:54:47.354 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.353+0000 7f59a583b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T12:54:47.493 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.492+0000 7f59a583b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T12:54:47.541 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.539+0000 7f59a583b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T12:54:47.587 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:54:47.659 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.658+0000 7f59a583b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:54:47.678 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.677+0000 7f254c532640 1 Processor -- start 2024-04-16T12:54:47.678 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.677+0000 7f254c532640 1 -- start start 2024-04-16T12:54:47.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254c532640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25440b6240 0x7f254406c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254c532640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25440b6790 con 0x7f254415c570 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254c532640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25440b4700 con 0x7f2544162c00 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254c532640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f25440b6a70 con 0x7f25440b6240 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25440b6240 0x7f254406c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25440b6240 0x7f254406c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49368/0 (socket says 172.21.15.18:49368) 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 -- 172.21.15.18:0/2383176597 learned_addr learned my addr 172.21.15.18:0/2383176597 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254a2ce640 1 --1- 172.21.15.18:0/2383176597 >> v1:172.21.15.18:6789/0 conn(0x7f254415c570 0x7f25441624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49036/0 (socket says 172.21.15.18:49036) 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 -- 172.21.15.18:0/2383176597 >> v1:172.21.15.104:6789/0 conn(0x7f2544162c00 legacy=0x7f25440b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 -- 172.21.15.18:0/2383176597 >> v1:172.21.15.18:6789/0 conn(0x7f254415c570 legacy=0x7f25441624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:47.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.678+0000 7f254aacf640 1 -- 172.21.15.18:0/2383176597 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25440b49e0 con 0x7f25440b6240 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.679+0000 7f254aacf640 1 --2- 172.21.15.18:0/2383176597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25440b6240 0x7f254406c430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f253c009e50 tx=0x7f253c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b890a76c5f7fb55f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.679+0000 7f25492cc640 1 -- 172.21.15.18:0/2383176597 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c02cb20 con 0x7f25440b6240 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.679+0000 7f25492cc640 1 -- 172.21.15.18:0/2383176597 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c02ccc0 con 0x7f25440b6240 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.679+0000 7f25492cc640 1 -- 172.21.15.18:0/2383176597 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c034610 con 0x7f25440b6240 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 -- 172.21.15.18:0/2383176597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25440b6240 msgr2=0x7f254406c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 --2- 172.21.15.18:0/2383176597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25440b6240 0x7f254406c430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f253c009e50 tx=0x7f253c02bf80 comp rx=0 tx=0).stop 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 -- 172.21.15.18:0/2383176597 shutdown_connections 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 --2- 172.21.15.18:0/2383176597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25440b6240 0x7f254406c430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 -- 172.21.15.18:0/2383176597 >> 172.21.15.18:0/2383176597 conn(0x7f254406d820 msgr2=0x7f254409aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:47.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 -- 172.21.15.18:0/2383176597 shutdown_connections 2024-04-16T12:54:47.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.680+0000 7f254c532640 1 -- 172.21.15.18:0/2383176597 wait complete. 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.681+0000 7f254c532640 1 Processor -- start 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.681+0000 7f254c532640 1 -- start start 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254415c570 0x7f2544153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:47.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25440b4cc0 con 0x7f2544162c00 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f254406c970 con 0x7f254415c570 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254c532640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f25440b4e40 con 0x7f25440b6240 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49372/0 (socket says 172.21.15.18:49372) 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 -- 172.21.15.18:0/978861016 learned_addr learned my addr 172.21.15.18:0/978861016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254a2ce640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f2549acd640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254415c570 0x7f2544153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254a2ce640 1 -- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 msgr2=0x7f25440ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254a2ce640 1 -- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 msgr2=0x7f25440ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254a2ce640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254a2ce640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 -- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 msgr2=0x7f25440ca8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 -- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254415c570 msgr2=0x7f2544153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254415c570 0x7f2544153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.682+0000 7f254aacf640 1 -- 172.21.15.18:0/978861016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544157200 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f254aacf640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f253c036040 tx=0x7f253c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c043020 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c03e450 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25441574e0 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c009510 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2544153840 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f253c046020 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.683+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f253c048b70 con 0x7f2544162c00 2024-04-16T12:54:47.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.684+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254409f850 con 0x7f2544162c00 2024-04-16T12:54:47.688 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.686+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f253c04d030 con 0x7f2544162c00 2024-04-16T12:54:47.750 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.749+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2544161fa0 con 0x7f2544162c00 2024-04-16T12:54:47.750 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.749+0000 7f2536ffd640 1 -- 172.21.15.18:0/978861016 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f253c02cb90 con 0x7f2544162c00 2024-04-16T12:54:47.751 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-16T12:54:47.751 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:46.526526+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 msgr2=0x7f2544152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f253c036040 tx=0x7f253c004a40 comp rx=0 tx=0).stop 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 shutdown_connections 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2544162c00 0x7f2544152110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f254415c570 0x7f2544153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 --2- 172.21.15.18:0/978861016 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25440b6240 0x7f25440ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 >> 172.21.15.18:0/978861016 conn(0x7f254406d820 msgr2=0x7f2544160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 shutdown_connections 2024-04-16T12:54:47.752 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:47.750+0000 7f254c532640 1 -- 172.21.15.18:0/978861016 wait complete. 2024-04-16T12:54:47.761 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T12:54:47.762 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.761+0000 7f59a583b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T12:54:47.925 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.923+0000 7f59a583b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T12:54:47.969 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:47.967+0000 7f59a583b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T12:54:48.060 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:48.059+0000 7f3e52844040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T12:54:48.132 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:48.131+0000 7f59a583b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T12:54:48.342 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:48.340+0000 7f3e52844040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T12:54:48.391 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:48.390+0000 7f3e52844040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T12:54:48.506 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:48.505+0000 7f3e52844040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T12:54:48.982 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:48.981+0000 7f59a583b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T12:54:49.274 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:49.272+0000 7f59a583b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T12:54:49.329 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:49.327+0000 7f59a583b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T12:54:49.450 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-16T12:54:49.449+0000 7f59a583b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T12:54:49.521 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:49.520+0000 7f3df349d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T12:54:49.521 INFO:tasks.ceph.mgr.x.smithi104.stderr:2024-04-16T12:54:49.520+0000 7f3df349d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T12:54:50.656 INFO:tasks.ceph.osd.6.smithi104.stderr:2024-04-16T12:54:50.654+0000 7f816cf14640 -1 osd.6 0 log_to_monitors true 2024-04-16T12:54:50.662 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-16T12:54:50.661+0000 7fbf2bec1640 -1 osd.1 0 log_to_monitors true 2024-04-16T12:54:50.687 INFO:tasks.ceph.osd.4.smithi104.stderr:2024-04-16T12:54:50.685+0000 7f7707811640 -1 osd.4 0 log_to_monitors true 2024-04-16T12:54:50.690 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-16T12:54:50.688+0000 7fa2f052a640 -1 osd.3 0 log_to_monitors true 2024-04-16T12:54:50.720 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-16T12:54:50.714+0000 7f0f298a6640 -1 osd.0 0 log_to_monitors true 2024-04-16T12:54:50.720 INFO:tasks.ceph.osd.5.smithi104.stderr:2024-04-16T12:54:50.714+0000 7fbba92b5640 -1 osd.5 0 log_to_monitors true 2024-04-16T12:54:50.729 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-16T12:54:50.726+0000 7f312c40e640 -1 osd.2 0 log_to_monitors true 2024-04-16T12:54:50.729 INFO:tasks.ceph.osd.7.smithi104.stderr:2024-04-16T12:54:50.725+0000 7fcd1f00e640 -1 osd.7 0 log_to_monitors true 2024-04-16T12:54:53.670 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-16T12:54:53.669+0000 7f3127e75640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T12:54:53.681 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-16T12:54:53.680+0000 7f311fc95640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:53.714 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-16T12:54:53.713+0000 7f0f2583c640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T12:54:53.725 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-16T12:54:53.724+0000 7f0f1d65c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:53.765 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-16T12:54:53.760+0000 7fbf27e57640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T12:54:53.769 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-16T12:54:53.768+0000 7fa2ec4c0640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T12:54:53.780 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-16T12:54:53.779+0000 7fbf1fc77640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:53.780 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-16T12:54:53.779+0000 7fa2e42e0640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:54.333 INFO:tasks.ceph.osd.4.smithi104.stderr:2024-04-16T12:54:54.332+0000 7f770317d640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T12:54:54.358 INFO:tasks.ceph.osd.4.smithi104.stderr:2024-04-16T12:54:54.353+0000 7f76faf9d640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:54.370 INFO:tasks.ceph.osd.5.smithi104.stderr:2024-04-16T12:54:54.369+0000 7fbba524b640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T12:54:54.387 INFO:tasks.ceph.osd.5.smithi104.stderr:2024-04-16T12:54:54.385+0000 7fbb9d06b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:54.405 INFO:tasks.ceph.osd.6.smithi104.stderr:2024-04-16T12:54:54.404+0000 7f8168eaa640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T12:54:54.409 INFO:tasks.ceph.osd.7.smithi104.stderr:2024-04-16T12:54:54.408+0000 7fcd1aa75640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T12:54:54.417 INFO:tasks.ceph.osd.6.smithi104.stderr:2024-04-16T12:54:54.416+0000 7f8160cca640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:54.422 INFO:tasks.ceph.osd.7.smithi104.stderr:2024-04-16T12:54:54.421+0000 7fcd12895640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T12:54:54.572 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:54:54.675 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.674+0000 7fe4005e2640 1 Processor -- start 2024-04-16T12:54:54.675 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.674+0000 7fe4005e2640 1 -- start start 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe4005e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3f8067a70 0x7fe3f806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe4005e2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f806bba0 con 0x7fe3f806d180 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe4005e2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f806be80 con 0x7fe3f815e8c0 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe4005e2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f806c160 con 0x7fe3f8067a70 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe3fdb7d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3f8067a70 0x7fe3f806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe3feb7f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe3f806d180 0x7fe3f80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48496/0 (socket says 172.21.15.18:48496) 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe3fdb7d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3f8067a70 0x7fe3f806cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46350/0 (socket says 172.21.15.18:46350) 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.675+0000 7fe3feb7f640 1 -- 172.21.15.18:0/996853375 learned_addr learned my addr 172.21.15.18:0/996853375 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:54:54.677 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.676+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/996853375 >> v1:172.21.15.104:6789/0 conn(0x7fe3f815e8c0 legacy=0x7fe3f806f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.678 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.676+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/996853375 >> v1:172.21.15.18:6789/0 conn(0x7fe3f806d180 legacy=0x7fe3f80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.678 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.676+0000 7fe3fd37c640 1 -- 172.21.15.18:0/996853375 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848491651 0 0) 0x7fe3f806bba0 con 0x7fe3f806d180 2024-04-16T12:54:54.678 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.676+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/996853375 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f806c440 con 0x7fe3f8067a70 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe3fdb7d640 1 --2- 172.21.15.18:0/996853375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f8067a70 0x7fe3f806cc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80097a0 tx=0x7fe3e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22491bb85251d1a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe3fd37c640 1 -- 172.21.15.18:0/996853375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8034070 con 0x7fe3f8067a70 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe3fd37c640 1 -- 172.21.15.18:0/996853375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e8030610 con 0x7fe3f8067a70 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe3fd37c640 1 -- 172.21.15.18:0/996853375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80309e0 con 0x7fe3f8067a70 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe4005e2640 1 -- 172.21.15.18:0/996853375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f8067a70 msgr2=0x7fe3f806cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe4005e2640 1 --2- 172.21.15.18:0/996853375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f8067a70 0x7fe3f806cc40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80097a0 tx=0x7fe3e802b960 comp rx=0 tx=0).stop 2024-04-16T12:54:54.679 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe4005e2640 1 -- 172.21.15.18:0/996853375 shutdown_connections 2024-04-16T12:54:54.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe4005e2640 1 --2- 172.21.15.18:0/996853375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f8067a70 0x7fe3f806cc40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.677+0000 7fe4005e2640 1 -- 172.21.15.18:0/996853375 >> 172.21.15.18:0/996853375 conn(0x7fe3f80d0cd0 msgr2=0x7fe3f80d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:54.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.678+0000 7fe4005e2640 1 -- 172.21.15.18:0/996853375 shutdown_connections 2024-04-16T12:54:54.680 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.678+0000 7fe4005e2640 1 -- 172.21.15.18:0/996853375 wait complete. 2024-04-16T12:54:54.682 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.679+0000 7fe4005e2640 1 Processor -- start 2024-04-16T12:54:54.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.679+0000 7fe4005e2640 1 -- start start 2024-04-16T12:54:54.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.679+0000 7fe4005e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f8067a70 0x7fe3f8158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:54.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:54.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f815e8c0 0x7fe3f8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:54.683 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f80b4700 con 0x7fe3f806d180 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f815eca0 con 0x7fe3f8067a70 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f80b4880 con 0x7fe3f815e8c0 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46358/0 (socket says 172.21.15.18:46358) 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/661116534 learned_addr learned my addr 172.21.15.18:0/661116534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fe37e640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f8067a70 0x7fe3f8158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:54.684 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3feb7f640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f815e8c0 0x7fe3f8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f815e8c0 msgr2=0x7fe3f8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f815e8c0 0x7fe3f8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f8067a70 msgr2=0x7fe3f8158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f8067a70 0x7fe3f8158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 -- 172.21.15.18:0/661116534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f815fc10 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3fdb7d640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80098c0 tx=0x7fe3e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8034040 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e8039a10 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8039de0 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.680+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f815fef0 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.681+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81586e0 con 0x7fe3f806d180 2024-04-16T12:54:54.685 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.682+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f809f120 con 0x7fe3f806d180 2024-04-16T12:54:54.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.682+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fe3e8037070 con 0x7fe3f806d180 2024-04-16T12:54:54.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.683+0000 7fe3eeffd640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 0x7fe3dc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:54:54.686 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.683+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3631+0+0 (secure 0 0 0) 0x7fe3e80ad260 con 0x7fe3f806d180 2024-04-16T12:54:54.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.683+0000 7fe3fe37e640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 0x7fe3dc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:54:54.687 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.683+0000 7fe3fe37e640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 0x7fe3dc06ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4000f60 tx=0x7fe3f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:54:54.690 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.688+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3e807b940 con 0x7fe3f806d180 2024-04-16T12:54:54.874 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.872+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3f8162220 con 0x7fe3f806d180 2024-04-16T12:54:54.874 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.873+0000 7fe3eeffd640 1 -- 172.21.15.18:0/661116534 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+9463 (secure 0 0 0) 0x7fe3e807fc40 con 0x7fe3f806d180 2024-04-16T12:54:54.874 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-16T12:54:54.875 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":13,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:54.382370+0000","last_up_change":"2024-04-16T12:54:54.382370+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:54:54.876 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 msgr2=0x7fe3dc06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.876 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 0x7fe3dc06ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4000f60 tx=0x7fe3f4009040 comp rx=0 tx=0).stop 2024-04-16T12:54:54.876 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 msgr2=0x7fe3f814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:54:54.876 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80098c0 tx=0x7fe3e80046c0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 shutdown_connections 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe3dc06c860 0x7fe3dc06ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe3f815e8c0 0x7fe3f8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3f806d180 0x7fe3f814f8b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 --2- 172.21.15.18:0/661116534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3f8067a70 0x7fe3f8158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 >> 172.21.15.18:0/661116534 conn(0x7fe3f80d0cd0 msgr2=0x7fe3f80ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 shutdown_connections 2024-04-16T12:54:54.877 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:54:54.875+0000 7fe4005e2640 1 -- 172.21.15.18:0/661116534 wait complete. 2024-04-16T12:54:54.886 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-04-16T12:55:01.693 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:01.797 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.796+0000 7f5c3357c640 1 Processor -- start 2024-04-16T12:55:01.798 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.796+0000 7f5c3357c640 1 -- start start 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 0x7f5c2c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2c0cff40 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2c0d2d20 con 0x7f5c2c0ba270 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c3357c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c0d3000 con 0x7f5c2c161ee0 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c31b19640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c31b19640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46360/0 (socket says 172.21.15.18:46360) 2024-04-16T12:55:01.799 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c31b19640 1 -- 172.21.15.18:0/4039799624 learned_addr learned my addr 172.21.15.18:0/4039799624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c31318640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.797+0000 7f5c30b17640 1 --2- 172.21.15.18:0/4039799624 >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 0x7f5c2c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 -- 172.21.15.18:0/4039799624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 msgr2=0x7f5c2c162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 -- 172.21.15.18:0/4039799624 >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 msgr2=0x7f5c2c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 --2- 172.21.15.18:0/4039799624 >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 0x7f5c2c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 -- 172.21.15.18:0/4039799624 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c162b90 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c30b17640 1 --2- 172.21.15.18:0/4039799624 >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 0x7f5c2c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:01.800 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31318640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:01.805 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c31b19640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c06bd40 tx=0x7f5c1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793e1c75d48660b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.798+0000 7f5c2bfff640 1 -- 172.21.15.18:0/4039799624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c02ca70 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c2bfff640 1 -- 172.21.15.18:0/4039799624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c02cc10 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c2bfff640 1 -- 172.21.15.18:0/4039799624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0343f0 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 -- 172.21.15.18:0/4039799624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0cfaf0 msgr2=0x7f5c2c06cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c06bd40 tx=0x7f5c1c02bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 -- 172.21.15.18:0/4039799624 shutdown_connections 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 --2- 172.21.15.18:0/4039799624 >> v2:172.21.15.104:3300/0 conn(0x7f5c2c0ba270 0x7f5c2c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c06cdc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 --2- 172.21.15.18:0/4039799624 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 -- 172.21.15.18:0/4039799624 >> 172.21.15.18:0/4039799624 conn(0x7f5c2c0d1540 msgr2=0x7f5c2c0d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 -- 172.21.15.18:0/4039799624 shutdown_connections 2024-04-16T12:55:01.806 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.799+0000 7f5c3357c640 1 -- 172.21.15.18:0/4039799624 wait complete. 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.800+0000 7f5c3357c640 1 Processor -- start 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.800+0000 7f5c3357c640 1 -- start start 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c1f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c0b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c1633f0 con 0x7f5c2c0ba270 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c163110 con 0x7f5c2c0cfaf0 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c3357c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c0b7a80 con 0x7f5c2c161ee0 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c31318640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c31318640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46374/0 (socket says 172.21.15.18:46374) 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c31318640 1 -- 172.21.15.18:0/3538686453 learned_addr learned my addr 172.21.15.18:0/3538686453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c31b19640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c0b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.801+0000 7f5c30b17640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c1f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 -- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 msgr2=0x7f5c2c0b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:01.807 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c0b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 -- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c2c0cfaf0 msgr2=0x7f5c2c1f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c1f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 -- 172.21.15.18:0/3538686453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c0c8300 con 0x7f5c2c0ba270 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31b19640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c0b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c31318640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400d7d0 tx=0x7f5c2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24004030 con 0x7f5c2c0ba270 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c240041d0 con 0x7f5c2c0ba270 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c1f8790 con 0x7f5c2c0ba270 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c240096a0 con 0x7f5c2c0ba270 2024-04-16T12:55:01.808 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.802+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c0c8570 con 0x7f5c2c0ba270 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.803+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c160550 con 0x7f5c2c0ba270 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.804+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c24009840 con 0x7f5c2c0ba270 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.804+0000 7f5c29ffb640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 0x7f5c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.804+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5c2408ba90 con 0x7f5c2c0ba270 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.804+0000 7f5c30b17640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 0x7f5c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:01.809 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.805+0000 7f5c30b17640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 0x7f5c1806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c20006fd0 tx=0x7f5c20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:01.810 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.809+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c2c160550 con 0x7f5c2c0ba270 2024-04-16T12:55:01.999 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.998+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c2c06e0f0 con 0x7f5c2c0ba270 2024-04-16T12:55:02.000 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:01.999+0000 7f5c29ffb640 1 -- 172.21.15.18:0/3538686453 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f5c2405a210 con 0x7f5c2c0ba270 2024-04-16T12:55:02.000 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-16T12:55:02.001 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":16,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:57.408365+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 msgr2=0x7f5c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 0x7f5c1806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c20006fd0 tx=0x7f5c20008040 comp rx=0 tx=0).stop 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 msgr2=0x7f5c2c152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400d7d0 tx=0x7f5c2400dc90 comp rx=0 tx=0).stop 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 shutdown_connections 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5c1806c8f0 0x7f5c1806edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5c2c161ee0 0x7f5c2c0b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.003 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c2c0cfaf0 0x7f5c2c1f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.004 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 --2- 172.21.15.18:0/3538686453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c2c0ba270 0x7f5c2c152cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.004 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 >> 172.21.15.18:0/3538686453 conn(0x7f5c2c0d1540 msgr2=0x7f5c2c0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.004 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 shutdown_connections 2024-04-16T12:55:02.004 INFO:teuthology.misc.health.smithi018.stderr:2024-04-16T12:55:02.001+0000 7f5c3357c640 1 -- 172.21.15.18:0/3538686453 wait complete. 2024-04-16T12:55:02.012 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T12:55:02.012 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T12:55:02.013 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T12:55:02.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T12:55:02.016 INFO:tasks.ceph.mds.a:Started 2024-04-16T12:55:02.016 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T12:55:02.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T12:55:02.019 INFO:tasks.ceph.mds.c:Started 2024-04-16T12:55:02.019 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T12:55:02.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T12:55:02.023 INFO:tasks.ceph.mds.b:Started 2024-04-16T12:55:02.023 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T12:55:02.023 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T12:55:02.025 INFO:tasks.ceph.mds.d:Started 2024-04-16T12:55:02.026 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T12:55:02.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:02.095 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-16T12:55:02.096 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-16T12:55:02.111 INFO:tasks.ceph.mds.b.smithi104.stdout:starting mds.b at 2024-04-16T12:55:02.111 INFO:tasks.ceph.mds.d.smithi104.stdout:starting mds.d at 2024-04-16T12:55:02.112 INFO:tasks.ceph.mds.b.smithi104.stderr:2024-04-16T12:55:02.110+0000 7fde9f5f6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.134+0000 7f15fec63640 1 Processor -- start 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.134+0000 7f15fec63640 1 -- start start 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fec63640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fec63640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15f815bc20 0x7f15f80b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fec63640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f80b2640 con 0x7f15f80b3820 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fec63640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f15f80b3da0 con 0x7f15f815bc20 2024-04-16T12:55:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fec63640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80b28c0 con 0x7f15f815b840 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fd200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f15f80b3820 0x7f15f806dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48510/0 (socket says 172.21.15.18:48510) 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fd200640 1 -- 172.21.15.18:0/3616950335 learned_addr learned my addr 172.21.15.18:0/3616950335 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15fc9ff640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.135+0000 7f15f7fff640 1 --2- 172.21.15.18:0/3616950335 >> v2:172.21.15.104:3300/0 conn(0x7f15f815bc20 0x7f15f80b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315091925 0 0) 0x7f15f0001490 con 0x7f15f80b3820 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e4003520 con 0x7f15f80b3820 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f7fff640 1 -- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 msgr2=0x7f15f80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f7fff640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1077756499 0 0) 0x7f15e4003520 con 0x7f15f80b3820 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f7fff640 1 -- 172.21.15.18:0/3616950335 >> v1:172.21.15.18:6789/0 conn(0x7f15f80b3820 legacy=0x7f15f806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.136+0000 7f15f7fff640 1 -- 172.21.15.18:0/3616950335 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f80b2ba0 con 0x7f15f815bc20 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15f7fff640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f815bc20 0x7f15f80b6c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15e00097a0 tx=0x7f15e002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f5449068fd1ce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0037070 con 0x7f15f815bc20 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0030510 con 0x7f15f815bc20 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15f77fe640 1 -- 172.21.15.18:0/3616950335 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0001bc0 con 0x7f15f815bc20 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 -- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f815bc20 msgr2=0x7f15f80b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f815bc20 0x7f15f80b6c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15e00097a0 tx=0x7f15e002b710 comp rx=0 tx=0).stop 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 -- 172.21.15.18:0/3616950335 shutdown_connections 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f815bc20 0x7f15f80b6c30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 --2- 172.21.15.18:0/3616950335 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.137+0000 7f15fec63640 1 -- 172.21.15.18:0/3616950335 >> 172.21.15.18:0/3616950335 conn(0x7f15f809aa10 msgr2=0x7f15f80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.138+0000 7f15fec63640 1 -- 172.21.15.18:0/3616950335 shutdown_connections 2024-04-16T12:55:02.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.138+0000 7f15fec63640 1 -- 172.21.15.18:0/3616950335 wait complete. 2024-04-16T12:55:02.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.139+0000 7f15fec63640 1 Processor -- start 2024-04-16T12:55:02.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.139+0000 7f15fec63640 1 -- start start 2024-04-16T12:55:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80b3820 0x7f15f80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f8154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15f806e440 con 0x7f15f8155630 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15f806e2c0 con 0x7f15f80b3820 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80ce0e0 con 0x7f15f815b840 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46412/0 (socket says 172.21.15.18:46412) 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 -- 172.21.15.18:0/2374256499 learned_addr learned my addr 172.21.15.18:0/2374256499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15f7fff640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f8154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fc9ff640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80b3820 0x7f15f80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 -- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 msgr2=0x7f15f8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f8154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 -- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80b3820 msgr2=0x7f15f80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80b3820 0x7f15f80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 -- 172.21.15.18:0/2374256499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f814f1b0 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fd200640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15f0001a60 tx=0x7f15f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0012400 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00125c0 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f814f490 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f00129b0 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.140+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f806bba0 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.141+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f8068a70 con 0x7f15f8155630 2024-04-16T12:55:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.142+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15f0012b50 con 0x7f15f8155630 2024-04-16T12:55:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.142+0000 7f15f57fa640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 0x7f15d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.142+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f15f008be80 con 0x7f15f8155630 2024-04-16T12:55:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.142+0000 7f15fc9ff640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 0x7f15d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.143+0000 7f15fc9ff640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 0x7f15d806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15f80d08f0 tx=0x7f15e8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.146+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15f80b2640 con 0x7f15f8155630 2024-04-16T12:55:02.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.332+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15f806bda0 con 0x7f15f8155630 2024-04-16T12:55:02.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.333+0000 7f15f57fa640 1 -- 172.21.15.18:0/2374256499 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f15f005a040 con 0x7f15f8155630 2024-04-16T12:55:02.334 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:02.334 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":16,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:57.408365+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:02.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 msgr2=0x7f15d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 0x7f15d806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15f80d08f0 tx=0x7f15e8009190 comp rx=0 tx=0).stop 2024-04-16T12:55:02.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 msgr2=0x7f15f814da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15f0001a60 tx=0x7f15f000a430 comp rx=0 tx=0).stop 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 shutdown_connections 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15d806c8f0 0x7f15d806edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f8155630 0x7f15f814da40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f815b840 0x7f15f8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 --2- 172.21.15.18:0/2374256499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80b3820 0x7f15f80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 >> 172.21.15.18:0/2374256499 conn(0x7f15f809aa10 msgr2=0x7f15f80d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 shutdown_connections 2024-04-16T12:55:02.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.335+0000 7f15fec63640 1 -- 172.21.15.18:0/2374256499 wait complete. 2024-04-16T12:55:02.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:55:02.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.455+0000 7f5fff352640 1 Processor -- start 2024-04-16T12:55:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.455+0000 7f5fff352640 1 -- start start 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5fff352640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 0x7f5ff80cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5fff352640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff815f100 con 0x7f5ff815ed20 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5fff352640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff80cfb30 con 0x7f5ff80b6390 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5fff352640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80cf740 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffd0ee640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ff815ed20 0x7f5ff80d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48522/0 (socket says 172.21.15.18:48522) 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffd0ee640 1 -- 172.21.15.18:0/3981132197 learned_addr learned my addr 172.21.15.18:0/3981132197 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/3981132197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 0x7f5ff80cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450949553 0 0) 0x7f5ff815f100 con 0x7f5ff815ed20 2024-04-16T12:55:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe4003520 con 0x7f5ff815ed20 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623072232 0 0) 0x7f5ff80cfb30 con 0x7f5ff80b6390 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff815f100 con 0x7f5ff80b6390 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffc8ed640 1 -- 172.21.15.18:0/3981132197 >> v1:172.21.15.104:6789/0 conn(0x7f5ff80b6390 legacy=0x7f5ff80b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffc8ed640 1 -- 172.21.15.18:0/3981132197 >> v1:172.21.15.18:6789/0 conn(0x7f5ff815ed20 legacy=0x7f5ff80d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2928034207 0 0) 0x7f5fe4003520 con 0x7f5ff815ed20 2024-04-16T12:55:02.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.456+0000 7f5ffc8ed640 1 -- 172.21.15.18:0/3981132197 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80cfe10 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.457+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/3981132197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 0x7f5ff80cf200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80097d0 tx=0x7f5fe802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a664f681c35dada server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.457+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8037070 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.457+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8030510 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.457+0000 7f5feffff640 1 -- 172.21.15.18:0/3981132197 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4001670 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 -- 172.21.15.18:0/3981132197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 msgr2=0x7f5ff80cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 --2- 172.21.15.18:0/3981132197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 0x7f5ff80cf200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80097d0 tx=0x7f5fe802b800 comp rx=0 tx=0).stop 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 -- 172.21.15.18:0/3981132197 shutdown_connections 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 --2- 172.21.15.18:0/3981132197 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff80b3ec0 0x7f5ff80cf200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 -- 172.21.15.18:0/3981132197 >> 172.21.15.18:0/3981132197 conn(0x7f5ff80d1390 msgr2=0x7f5ff80d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 -- 172.21.15.18:0/3981132197 shutdown_connections 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.458+0000 7f5fff352640 1 -- 172.21.15.18:0/3981132197 wait complete. 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.459+0000 7f5fff352640 1 Processor -- start 2024-04-16T12:55:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.459+0000 7f5fff352640 1 -- start start 2024-04-16T12:55:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 0x7f5ff80ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 0x7f5ff80cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80d38e0 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80cf8e0 con 0x7f5ff80b6390 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fff352640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80d00f0 con 0x7f5ff815ed20 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46418/0 (socket says 172.21.15.18:46418) 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 -- 172.21.15.18:0/2099566122 learned_addr learned my addr 172.21.15.18:0/2099566122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 0x7f5ff80ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd8ef640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 0x7f5ff80cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 -- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 msgr2=0x7f5ff80cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 0x7f5ff80cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 -- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 msgr2=0x7f5ff80ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 0x7f5ff80ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 -- 172.21.15.18:0/2099566122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff814d680 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 0x7f5ff80ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd8ef640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 0x7f5ff80cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5ffd0ee640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c780 tx=0x7f5ff400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.460+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4017070 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.461+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff4005af0 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.461+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4007070 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.461+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff814d960 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.461+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff814df20 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.462+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff80752b0 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.462+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ff401a070 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.462+0000 7f5fedffb640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 0x7f5fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.462+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5ff408ad10 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.463+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 0x7f5fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.463+0000 7f5ffc8ed640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 0x7f5fdc06edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8034000 tx=0x7f5fe8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.467+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ff4059520 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.650+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5ff814e160 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.651+0000 7f5fedffb640 1 -- 172.21.15.18:0/2099566122 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f5ff4058e20 con 0x7f5ff80b3ec0 2024-04-16T12:55:02.652 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 msgr2=0x7f5fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 0x7f5fdc06edb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8034000 tx=0x7f5fe8008030 comp rx=0 tx=0).stop 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 msgr2=0x7f5ff814cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c780 tx=0x7f5ff400cc40 comp rx=0 tx=0).stop 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 shutdown_connections 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fdc06c8f0 0x7f5fdc06edb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5ff815ed20 0x7f5ff80cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ff80b6390 0x7f5ff80ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 --2- 172.21.15.18:0/2099566122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ff80b3ec0 0x7f5ff814cdc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 >> 172.21.15.18:0/2099566122 conn(0x7f5ff80d1390 msgr2=0x7f5ff80d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 shutdown_connections 2024-04-16T12:55:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.653+0000 7f5fff352640 1 -- 172.21.15.18:0/2099566122 wait complete. 2024-04-16T12:55:02.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.768+0000 7f13d747e640 1 Processor -- start 2024-04-16T12:55:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.768+0000 7f13d747e640 1 -- start start 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d747e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f13d015ef70 0x7f13d006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d747e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d747e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d00cfe40 con 0x7f13d00b3390 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d747e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f13d00d0120 con 0x7f13d015ef70 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d747e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f13d00d2470 con 0x7f13d00b3ea0 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d4a19640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d4a19640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:49322/0 (socket says 172.21.15.18:49322) 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d4a19640 1 -- 172.21.15.18:0/1860454100 learned_addr learned my addr 172.21.15.18:0/1860454100 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.769+0000 7f13d521a640 1 --2- 172.21.15.18:0/1860454100 >> v2:172.21.15.104:3300/0 conn(0x7f13d015ef70 0x7f13d006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.770+0000 7f13d4a19640 1 -- 172.21.15.18:0/1860454100 >> v2:172.21.15.104:3300/0 conn(0x7f13d015ef70 msgr2=0x7f13d006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.770+0000 7f13d4a19640 1 --2- 172.21.15.18:0/1860454100 >> v2:172.21.15.104:3300/0 conn(0x7f13d015ef70 0x7f13d006ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.770+0000 7f13d4a19640 1 -- 172.21.15.18:0/1860454100 >> v1:172.21.15.104:6789/0 conn(0x7f13d00b3390 legacy=0x7f13d01628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.770+0000 7f13d4a19640 1 -- 172.21.15.18:0/1860454100 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00d2750 con 0x7f13d00b3ea0 2024-04-16T12:55:02.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.770+0000 7f13d4a19640 1 --2- 172.21.15.18:0/1860454100 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009870 tx=0x7f13c002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504607ca8a3c38f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13c7fff640 1 -- 172.21.15.18:0/1860454100 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0034070 con 0x7f13d00b3ea0 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13c7fff640 1 -- 172.21.15.18:0/1860454100 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c0030840 con 0x7f13d00b3ea0 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13c7fff640 1 -- 172.21.15.18:0/1860454100 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0030c10 con 0x7f13d00b3ea0 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 -- 172.21.15.18:0/1860454100 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 msgr2=0x7f13d006bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 --2- 172.21.15.18:0/1860454100 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009870 tx=0x7f13c002b980 comp rx=0 tx=0).stop 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 -- 172.21.15.18:0/1860454100 shutdown_connections 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 --2- 172.21.15.18:0/1860454100 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3ea0 0x7f13d006bf60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 --2- 172.21.15.18:0/1860454100 >> v2:172.21.15.104:3300/0 conn(0x7f13d015ef70 0x7f13d006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 -- 172.21.15.18:0/1860454100 >> 172.21.15.18:0/1860454100 conn(0x7f13d00b69e0 msgr2=0x7f13d00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 -- 172.21.15.18:0/1860454100 shutdown_connections 2024-04-16T12:55:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.771+0000 7f13d747e640 1 -- 172.21.15.18:0/1860454100 wait complete. 2024-04-16T12:55:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.772+0000 7f13d747e640 1 Processor -- start 2024-04-16T12:55:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.772+0000 7f13d747e640 1 -- start start 2024-04-16T12:55:02.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3390 0x7f13d00ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13d00b3ea0 0x7f13d00cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d00d3e00 con 0x7f13d0151c40 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f13d00d3c80 con 0x7f13d00b3ea0 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d747e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f13d00d3f80 con 0x7f13d00b3390 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d5a1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d5a1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46424/0 (socket says 172.21.15.18:46424) 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d5a1b640 1 -- 172.21.15.18:0/2942768394 learned_addr learned my addr 172.21.15.18:0/2942768394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d521a640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3390 0x7f13d00ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d4a19640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13d00b3ea0 0x7f13d00cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d5a1b640 1 -- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3390 msgr2=0x7f13d00ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.773+0000 7f13d5a1b640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3390 0x7f13d00ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d5a1b640 1 -- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13d00b3ea0 msgr2=0x7f13d00cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d5a1b640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13d00b3ea0 0x7f13d00cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d5a1b640 1 -- 172.21.15.18:0/2942768394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00ae600 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d5a1b640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13c8001eb0 tx=0x7f13c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8017070 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c80052d0 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d00ccae0 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8003810 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.774+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d00cd0a0 con 0x7f13d0151c40 2024-04-16T12:55:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.775+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d00d0790 con 0x7f13d0151c40 2024-04-16T12:55:02.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.775+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13c801a070 con 0x7f13d0151c40 2024-04-16T12:55:02.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.776+0000 7f13c5ffb640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 0x7f13b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:02.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.776+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f13c808ab00 con 0x7f13d0151c40 2024-04-16T12:55:02.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.776+0000 7f13d521a640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 0x7f13b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.777+0000 7f13d521a640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 0x7f13b406ede0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0073f0 tx=0x7f13cc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:02.780+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13d00d0790 con 0x7f13d0151c40 2024-04-16T12:55:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.003+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13d015e4a0 con 0x7f13d0151c40 2024-04-16T12:55:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.003+0000 7f13c5ffb640 1 -- 172.21.15.18:0/2942768394 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f13d015e4a0 con 0x7f13d0151c40 2024-04-16T12:55:03.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:03.005 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T12:55:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 msgr2=0x7f13b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 0x7f13b406ede0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0073f0 tx=0x7f13cc00b040 comp rx=0 tx=0).stop 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 msgr2=0x7f13d00ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13c8001eb0 tx=0x7f13c800c890 comp rx=0 tx=0).stop 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 shutdown_connections 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f13b406c920 0x7f13b406ede0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d0151c40 0x7f13d00ac4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13d00b3ea0 0x7f13d00cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 --2- 172.21.15.18:0/2942768394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13d00b3390 0x7f13d00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:03.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.005+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 >> 172.21.15.18:0/2942768394 conn(0x7f13d00b69e0 msgr2=0x7f13d00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:03.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.006+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 shutdown_connections 2024-04-16T12:55:03.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:03.006+0000 7f13d747e640 1 -- 172.21.15.18:0/2942768394 wait complete. 2024-04-16T12:55:04.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:55:04.545 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:55:05.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.134+0000 7f9cb953f640 1 Processor -- start 2024-04-16T12:55:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.134+0000 7f9cb953f640 1 -- start start 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb953f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb40d1740 0x7f9cb409b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb953f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9cb4071400 0x7f9cb40d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb953f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb4070e10 con 0x7f9cb409aa10 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb953f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb40d2480 con 0x7f9cb4071400 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb953f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb40720c0 con 0x7f9cb40d1740 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9caa7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9cb4071400 0x7f9cb40d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9cb409aa10 0x7f9cb406d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35412/0 (socket says 172.21.15.18:35412) 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb37fe640 1 -- 172.21.15.18:0/3474500744 learned_addr learned my addr 172.21.15.18:0/3474500744 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9cb2ffd640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb40d1740 0x7f9cb409b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9caa7fc640 1 -- 172.21.15.18:0/3474500744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb40d1740 msgr2=0x7f9cb409b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9caa7fc640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb40d1740 0x7f9cb409b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9caa7fc640 1 -- 172.21.15.18:0/3474500744 >> v1:172.21.15.18:6789/0 conn(0x7f9cb409aa10 legacy=0x7f9cb406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.135+0000 7f9caa7fc640 1 -- 172.21.15.18:0/3474500744 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb40d0bd0 con 0x7f9cb4071400 2024-04-16T12:55:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9caa7fc640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb4071400 0x7f9cb40d0690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0097a0 tx=0x7f9c9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca2a376c0a9e6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9cb27fc640 1 -- 172.21.15.18:0/3474500744 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c035020 con 0x7f9cb4071400 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9cb27fc640 1 -- 172.21.15.18:0/3474500744 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c031830 con 0x7f9cb4071400 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9cb27fc640 1 -- 172.21.15.18:0/3474500744 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c031c00 con 0x7f9cb4071400 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9cb953f640 1 -- 172.21.15.18:0/3474500744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb4071400 msgr2=0x7f9cb40d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.136+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb4071400 0x7f9cb40d0690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0097a0 tx=0x7f9c9c02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 -- 172.21.15.18:0/3474500744 shutdown_connections 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb4071400 0x7f9cb40d0690 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3474500744 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb40d1740 0x7f9cb409b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 -- 172.21.15.18:0/3474500744 >> 172.21.15.18:0/3474500744 conn(0x7f9cb40d2600 msgr2=0x7f9cb40d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 -- 172.21.15.18:0/3474500744 shutdown_connections 2024-04-16T12:55:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.137+0000 7f9cb953f640 1 -- 172.21.15.18:0/3474500744 wait complete. 2024-04-16T12:55:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.138+0000 7f9cb953f640 1 Processor -- start 2024-04-16T12:55:05.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.138+0000 7f9cb953f640 1 -- start start 2024-04-16T12:55:05.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cb4071400 0x7f9cb40b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb409aa10 0x7f9cb40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb406cb30 con 0x7f9cb40d1740 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb40710b0 con 0x7f9cb4071400 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb953f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb40d1b20 con 0x7f9cb409aa10 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36340/0 (socket says 172.21.15.18:36340) 2024-04-16T12:55:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 -- 172.21.15.18:0/3491361776 learned_addr learned my addr 172.21.15.18:0/3491361776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9caa7fc640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb409aa10 0x7f9cb40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb2ffd640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cb4071400 0x7f9cb40b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 -- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb409aa10 msgr2=0x7f9cb40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb409aa10 0x7f9cb40b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 -- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cb4071400 msgr2=0x7f9cb40b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cb4071400 0x7f9cb40b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 -- 172.21.15.18:0/3491361776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb40b7020 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.139+0000 7f9cb37fe640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00cbf0 tx=0x7f9cac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.140+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac017070 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.140+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac00ad40 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.140+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb40b72a0 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.140+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac012600 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.140+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb40b7860 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.141+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb40752b0 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.141+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cac01a070 con 0x7f9cb40d1740 2024-04-16T12:55:05.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.142+0000 7f9cabfff640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.142+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9cac08b460 con 0x7f9cb40d1740 2024-04-16T12:55:05.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.142+0000 7f9cb2ffd640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.142+0000 7f9cb2ffd640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 0x7f9c9406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415dd90 tx=0x7f9ca4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.146+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9cb40b7020 con 0x7f9cb40d1740 2024-04-16T12:55:05.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.369+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb40c6910 con 0x7f9cb40d1740 2024-04-16T12:55:05.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.370+0000 7f9cabfff640 1 -- 172.21.15.18:0/3491361776 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3872 (secure 0 0 0) 0x7f9cac059590 con 0x7f9cb40d1740 2024-04-16T12:55:05.371 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:05.372 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-16T12:55:05.372 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 msgr2=0x7f9c9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 0x7f9c9406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cb415dd90 tx=0x7f9ca4008040 comp rx=0 tx=0).stop 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 msgr2=0x7f9cb4146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00cbf0 tx=0x7f9cac00a430 comp rx=0 tx=0).stop 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 shutdown_connections 2024-04-16T12:55:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cb40d1740 0x7f9cb4146850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9cb409aa10 0x7f9cb40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 --2- 172.21.15.18:0/3491361776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cb4071400 0x7f9cb40b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 >> 172.21.15.18:0/3491361776 conn(0x7f9cb40d2600 msgr2=0x7f9cb40af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 shutdown_connections 2024-04-16T12:55:05.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.372+0000 7f9cb953f640 1 -- 172.21.15.18:0/3491361776 wait complete. 2024-04-16T12:55:05.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:05.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.488+0000 7f26594e4640 1 Processor -- start 2024-04-16T12:55:05.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.488+0000 7f26594e4640 1 -- start start 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26594e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f265406c130 0x7f26540d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26594e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26540b3a00 0x7f26540d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26594e4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2654163480 con 0x7f265415ef70 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26594e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f265415f350 con 0x7f26540b3a00 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26594e4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f26540d2470 con 0x7f265406c130 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26540b3a00 0x7f26540d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26540b3a00 0x7f26540d3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36344/0 (socket says 172.21.15.18:36344) 2024-04-16T12:55:05.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 -- 172.21.15.18:0/3538986971 learned_addr learned my addr 172.21.15.18:0/3538986971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f264a7fc640 1 --2- 172.21.15.18:0/3538986971 >> v2:172.21.15.104:3300/0 conn(0x7f265406c130 0x7f26540d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 -- 172.21.15.18:0/3538986971 >> v2:172.21.15.104:3300/0 conn(0x7f265406c130 msgr2=0x7f26540d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 --2- 172.21.15.18:0/3538986971 >> v2:172.21.15.104:3300/0 conn(0x7f265406c130 0x7f26540d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 -- 172.21.15.18:0/3538986971 >> v1:172.21.15.104:6789/0 conn(0x7f265415ef70 legacy=0x7f265406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.489+0000 7f26537fe640 1 -- 172.21.15.18:0/3538986971 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2654163760 con 0x7f26540b3a00 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26537fe640 1 --2- 172.21.15.18:0/3538986971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540d3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26540d25f0 tx=0x7f264c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfafa7158b84ff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26527fc640 1 -- 172.21.15.18:0/3538986971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c02ca70 con 0x7f26540b3a00 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26527fc640 1 -- 172.21.15.18:0/3538986971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c02cc10 con 0x7f26540b3a00 2024-04-16T12:55:05.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26527fc640 1 -- 172.21.15.18:0/3538986971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0343f0 con 0x7f26540b3a00 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 -- 172.21.15.18:0/3538986971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 msgr2=0x7f26540d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 --2- 172.21.15.18:0/3538986971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540d3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f26540d25f0 tx=0x7f264c02bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 -- 172.21.15.18:0/3538986971 shutdown_connections 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 --2- 172.21.15.18:0/3538986971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540d3400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 --2- 172.21.15.18:0/3538986971 >> v2:172.21.15.104:3300/0 conn(0x7f265406c130 0x7f26540d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.490+0000 7f26594e4640 1 -- 172.21.15.18:0/3538986971 >> 172.21.15.18:0/3538986971 conn(0x7f26540b69e0 msgr2=0x7f26540d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.491+0000 7f26594e4640 1 -- 172.21.15.18:0/3538986971 shutdown_connections 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.491+0000 7f26594e4640 1 -- 172.21.15.18:0/3538986971 wait complete. 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.492+0000 7f26594e4640 1 Processor -- start 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.492+0000 7f26594e4640 1 -- start start 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f265406c130 0x7f26541f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f265415ef70 0x7f2654159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f26540d5160 con 0x7f26540b3a00 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f26540d2a30 con 0x7f265406c130 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f26540b34b0 con 0x7f265415ef70 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36354/0 (socket says 172.21.15.18:36354) 2024-04-16T12:55:05.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 -- 172.21.15.18:0/953608216 learned_addr learned my addr 172.21.15.18:0/953608216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f2652ffd640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f265406c130 0x7f26541f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26537fe640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f265415ef70 0x7f2654159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 -- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f265415ef70 msgr2=0x7f2654159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f265415ef70 0x7f2654159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 -- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f265406c130 msgr2=0x7f26541f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f265406c130 0x7f26541f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 -- 172.21.15.18:0/953608216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26541f8fb0 con 0x7f26540b3a00 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264a7fc640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f263c00d800 tx=0x7f263c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00b6c0 con 0x7f26540b3a00 2024-04-16T12:55:05.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c019070 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00ba80 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26541f4fb0 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.493+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26540c87c0 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.494+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26540752b0 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.495+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f263c00bc20 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.495+0000 7f264bfff640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 0x7f263406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.495+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f263c08baf0 con 0x7f26540b3a00 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.495+0000 7f2652ffd640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 0x7f263406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.496+0000 7f2652ffd640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 0x7f263406edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2644006fd0 tx=0x7f2644009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.499+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26541f4fb0 con 0x7f26540b3a00 2024-04-16T12:55:05.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.687+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26540d1100 con 0x7f26540b3a00 2024-04-16T12:55:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.688+0000 7f264bfff640 1 -- 172.21.15.18:0/953608216 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f263c059cb0 con 0x7f26540b3a00 2024-04-16T12:55:05.689 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:05.689 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":16,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:54:57.408365+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 msgr2=0x7f263406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 0x7f263406edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2644006fd0 tx=0x7f2644009060 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 msgr2=0x7f26540cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f263c00d800 tx=0x7f263c00dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 shutdown_connections 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f263406c8f0 0x7f263406edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f265415ef70 0x7f2654159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26540b3a00 0x7f26540cda30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 --2- 172.21.15.18:0/953608216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f265406c130 0x7f26541f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 >> 172.21.15.18:0/953608216 conn(0x7f26540b69e0 msgr2=0x7f26540b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 shutdown_connections 2024-04-16T12:55:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.690+0000 7f26594e4640 1 -- 172.21.15.18:0/953608216 wait complete. 2024-04-16T12:55:05.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:55:05.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.809+0000 7f221b932640 1 Processor -- start 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.809+0000 7f221b932640 1 -- start start 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f221b932640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22140b3ec0 0x7f22140cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f221b932640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f221b932640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221415f100 con 0x7f221415ed20 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f221b932640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f22140cf740 con 0x7f22140b3ec0 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f221b932640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f22140cf8e0 con 0x7f22140b6390 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f22196ce640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f221415ed20 0x7f22140d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35418/0 (socket says 172.21.15.18:35418) 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f22196ce640 1 -- 172.21.15.18:0/54398882 learned_addr learned my addr 172.21.15.18:0/54398882 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2218ecd640 1 --2- 172.21.15.18:0/54398882 >> v2:172.21.15.104:3300/0 conn(0x7f22140b3ec0 0x7f22140cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2219ecf640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f220bfff640 1 -- 172.21.15.18:0/54398882 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227428663 0 0) 0x7f221415f100 con 0x7f221415ed20 2024-04-16T12:55:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f220bfff640 1 -- 172.21.15.18:0/54398882 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2200003520 con 0x7f221415ed20 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2218ecd640 1 -- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 msgr2=0x7f22140b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2218ecd640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2218ecd640 1 -- 172.21.15.18:0/54398882 >> v1:172.21.15.18:6789/0 conn(0x7f221415ed20 legacy=0x7f22140d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2218ecd640 1 -- 172.21.15.18:0/54398882 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22140cfb30 con 0x7f22140b3ec0 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.810+0000 7f2219ecf640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.811+0000 7f2218ecd640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f22140cf200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22040097a0 tx=0x7f220402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7073b930b939151c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.811+0000 7f220bfff640 1 -- 172.21.15.18:0/54398882 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204035020 con 0x7f22140b3ec0 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.811+0000 7f220bfff640 1 -- 172.21.15.18:0/54398882 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204031830 con 0x7f22140b3ec0 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.811+0000 7f220bfff640 1 -- 172.21.15.18:0/54398882 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204031be0 con 0x7f22140b3ec0 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 -- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 msgr2=0x7f22140cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f22140cf200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22040097a0 tx=0x7f220402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 -- 172.21.15.18:0/54398882 shutdown_connections 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 --2- 172.21.15.18:0/54398882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f22140cf200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 -- 172.21.15.18:0/54398882 >> 172.21.15.18:0/54398882 conn(0x7f22140d1390 msgr2=0x7f22140d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 -- 172.21.15.18:0/54398882 shutdown_connections 2024-04-16T12:55:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.812+0000 7f221b932640 1 -- 172.21.15.18:0/54398882 wait complete. 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.813+0000 7f221b932640 1 Processor -- start 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.813+0000 7f221b932640 1 -- start start 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f2214157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d38e0 con 0x7f221415ed20 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d3600 con 0x7f22140b3ec0 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f221b932640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f22140d00f0 con 0x7f22140b6390 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36362/0 (socket says 172.21.15.18:36362) 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 -- 172.21.15.18:0/1618726374 learned_addr learned my addr 172.21.15.18:0/1618726374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2218ecd640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f22196ce640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f2214157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 -- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 msgr2=0x7f22140ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 -- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 msgr2=0x7f2214157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f2214157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 -- 172.21.15.18:0/1618726374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22140c9db0 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2218ecd640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f22196ce640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f2214157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.814+0000 7f2219ecf640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f220c009e50 tx=0x7f220c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.815+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c018030 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.815+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f220c00cd90 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.815+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22140ca090 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.815+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c003bb0 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.815+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22140ca650 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.816+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22140752b0 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.816+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f220c01b070 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.817+0000 7f2209ffb640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 0x7f21f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.817+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f220c08c170 con 0x7f221415ed20 2024-04-16T12:55:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.817+0000 7f22196ce640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 0x7f21f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.817+0000 7f22196ce640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 0x7f21f806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2210007fd0 tx=0x7f2210009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:05.821+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f220c010040 con 0x7f221415ed20 2024-04-16T12:55:06.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.005+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22140b4e50 con 0x7f221415ed20 2024-04-16T12:55:06.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.005+0000 7f2209ffb640 1 -- 172.21.15.18:0/1618726374 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f220c05a2a0 con 0x7f221415ed20 2024-04-16T12:55:06.007 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 msgr2=0x7f21f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 0x7f21f806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2210007fd0 tx=0x7f2210009040 comp rx=0 tx=0).stop 2024-04-16T12:55:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 msgr2=0x7f22140cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f220c009e50 tx=0x7f220c00c490 comp rx=0 tx=0).stop 2024-04-16T12:55:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 shutdown_connections 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21f806c920 0x7f21f806ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f221415ed20 0x7f22140cc260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22140b6390 0x7f22140ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 --2- 172.21.15.18:0/1618726374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22140b3ec0 0x7f2214157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 >> 172.21.15.18:0/1618726374 conn(0x7f22140d1390 msgr2=0x7f221415def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 shutdown_connections 2024-04-16T12:55:06.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.007+0000 7f221b932640 1 -- 172.21.15.18:0/1618726374 wait complete. 2024-04-16T12:55:06.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T12:55:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.122+0000 7ff4c6700640 1 Processor -- start 2024-04-16T12:55:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 -- start start 2024-04-16T12:55:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00ce7f0 0x7ff4c00d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4c006da30 0x7ff4c00cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c009be70 con 0x7ff4c00d1f80 2024-04-16T12:55:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c00d0c40 con 0x7ff4c006da30 2024-04-16T12:55:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c6700640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c00d0ee0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4c4c9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4c006da30 0x7ff4c00cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4bf7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff4c00d1f80 0x7ff4c006d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35426/0 (socket says 172.21.15.18:35426) 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.123+0000 7ff4bf7fe640 1 -- 172.21.15.18:0/3587865560 learned_addr learned my addr 172.21.15.18:0/3587865560 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4bffff640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00ce7f0 0x7ff4c00d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4c4c9d640 1 -- 172.21.15.18:0/3587865560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00ce7f0 msgr2=0x7ff4c00d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4c4c9d640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00ce7f0 0x7ff4c00d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4c4c9d640 1 -- 172.21.15.18:0/3587865560 >> v1:172.21.15.18:6789/0 conn(0x7ff4c00d1f80 legacy=0x7ff4c006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4beffd640 1 -- 172.21.15.18:0/3587865560 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163737557 0 0) 0x7ff4c009be70 con 0x7ff4c00d1f80 2024-04-16T12:55:06.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.124+0000 7ff4c4c9d640 1 -- 172.21.15.18:0/3587865560 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c00d11c0 con 0x7ff4c006da30 2024-04-16T12:55:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c4c9d640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c006da30 0x7ff4c00cccc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009d90 tx=0x7ff4b802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c98a91a42ad988 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4beffd640 1 -- 172.21.15.18:0/3587865560 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8039070 con 0x7ff4c006da30 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4beffd640 1 -- 172.21.15.18:0/3587865560 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b802cbc0 con 0x7ff4c006da30 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4beffd640 1 -- 172.21.15.18:0/3587865560 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8034440 con 0x7ff4c006da30 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 -- 172.21.15.18:0/3587865560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c006da30 msgr2=0x7ff4c00cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c006da30 0x7ff4c00cccc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009d90 tx=0x7ff4b802be10 comp rx=0 tx=0).stop 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 -- 172.21.15.18:0/3587865560 shutdown_connections 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c006da30 0x7ff4c00cccc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 --2- 172.21.15.18:0/3587865560 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00ce7f0 0x7ff4c00d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 -- 172.21.15.18:0/3587865560 >> 172.21.15.18:0/3587865560 conn(0x7ff4c00b4160 msgr2=0x7ff4c00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 -- 172.21.15.18:0/3587865560 shutdown_connections 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.125+0000 7ff4c6700640 1 -- 172.21.15.18:0/3587865560 wait complete. 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.126+0000 7ff4c6700640 1 Processor -- start 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 -- start start 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 0x7ff4c00b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00d1f80 0x7ff4c00cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c00d1a60 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c00d1780 con 0x7ff4c006da30 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4c6700640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c009b6d0 con 0x7ff4c00d1f80 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36382/0 (socket says 172.21.15.18:36382) 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.127+0000 7ff4bf7fe640 1 -- 172.21.15.18:0/1933186476 learned_addr learned my addr 172.21.15.18:0/1933186476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4c4c9d640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00d1f80 0x7ff4c00cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bffff640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 0x7ff4c00b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 -- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00d1f80 msgr2=0x7ff4c00cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00d1f80 0x7ff4c00cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 -- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 msgr2=0x7ff4c00b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 0x7ff4c00b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 -- 172.21.15.18:0/1933186476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c00b81b0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bffff640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 0x7ff4c00b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bf7fe640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c460 tx=0x7ff4b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4018070 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b4007500 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c00b7bf0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4004a20 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.128+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c00c62d0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.129+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c0068a70 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.129+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4b4004bc0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.130+0000 7ff4bcff9640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 0x7ff4ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.130+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff4b408aaa0 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.130+0000 7ff4bffff640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 0x7ff4ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.131+0000 7ff4bffff640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 0x7ff4ac06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006fd0 tx=0x7ff4b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.134+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4b4059230 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.323+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff4c00c9400 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.323+0000 7ff4bcff9640 1 -- 172.21.15.18:0/1933186476 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff4b4058b30 con 0x7ff4c00ce7f0 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:55:06.325 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.325+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 msgr2=0x7ff4ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.325+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 0x7ff4ac06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006fd0 tx=0x7ff4b0008040 comp rx=0 tx=0).stop 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.325+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 msgr2=0x7ff4c0159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.325+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c460 tx=0x7ff4b400c920 comp rx=0 tx=0).stop 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 shutdown_connections 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff4ac06c920 0x7ff4ac06ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff4c00d1f80 0x7ff4c00cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4c00ce7f0 0x7ff4c0159e70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 --2- 172.21.15.18:0/1933186476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4c006da30 0x7ff4c00b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 >> 172.21.15.18:0/1933186476 conn(0x7ff4c00b4160 msgr2=0x7ff4c0070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:06.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 shutdown_connections 2024-04-16T12:55:06.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.326+0000 7ff4c6700640 1 -- 172.21.15.18:0/1933186476 wait complete. 2024-04-16T12:55:06.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T12:55:06.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T12:55:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.446+0000 7fc7b5340640 1 Processor -- start 2024-04-16T12:55:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.446+0000 7fc7b5340640 1 -- start start 2024-04-16T12:55:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc7b00d0630 0x7fc7b015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00cecf0 0x7fc7b015c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 0x7fc7b00cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b00b70d0 con 0x7fc7b00d0630 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b01605a0 con 0x7fc7b015ccb0 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7b5340640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b0160840 con 0x7fc7b00cecf0 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc7b00d0630 0x7fc7b015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc7b00d0630 0x7fc7b015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36386/0 (socket says 172.21.15.18:36386) 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 -- 172.21.15.18:0/2734819979 learned_addr learned my addr 172.21.15.18:0/2734819979 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7af7fe640 1 --2- 172.21.15.18:0/2734819979 >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 0x7fc7b00cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7a67fc640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00cecf0 0x7fc7b015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 -- 172.21.15.18:0/2734819979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00cecf0 msgr2=0x7fc7b015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00cecf0 0x7fc7b015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 -- 172.21.15.18:0/2734819979 >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 msgr2=0x7fc7b00cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/2734819979 >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 0x7fc7b00cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7aeffd640 1 -- 172.21.15.18:0/2734819979 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0160b20 con 0x7fc7b00d0630 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.447+0000 7fc7af7fe640 1 --2- 172.21.15.18:0/2734819979 >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 0x7fc7b00cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.448+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b00d0630 0x7fc7b015c230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00b74c0 tx=0x7fc7a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed9992f044a185a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.448+0000 7fc7ae7fc640 1 -- 172.21.15.18:0/2734819979 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0035020 con 0x7fc7b00d0630 2024-04-16T12:55:06.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.448+0000 7fc7ae7fc640 1 -- 172.21.15.18:0/2734819979 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a0031870 con 0x7fc7b00d0630 2024-04-16T12:55:06.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.448+0000 7fc7ae7fc640 1 -- 172.21.15.18:0/2734819979 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0031c40 con 0x7fc7b00d0630 2024-04-16T12:55:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 -- 172.21.15.18:0/2734819979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b00d0630 msgr2=0x7fc7b015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b00d0630 0x7fc7b015c230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00b74c0 tx=0x7fc7a002b910 comp rx=0 tx=0).stop 2024-04-16T12:55:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 -- 172.21.15.18:0/2734819979 shutdown_connections 2024-04-16T12:55:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 --2- 172.21.15.18:0/2734819979 >> v2:172.21.15.104:3300/0 conn(0x7fc7b015ccb0 0x7fc7b00cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00cecf0 0x7fc7b015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 --2- 172.21.15.18:0/2734819979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b00d0630 0x7fc7b015c230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 -- 172.21.15.18:0/2734819979 >> 172.21.15.18:0/2734819979 conn(0x7fc7b009aa10 msgr2=0x7fc7b00b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 -- 172.21.15.18:0/2734819979 shutdown_connections 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.449+0000 7fc7b5340640 1 -- 172.21.15.18:0/2734819979 wait complete. 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.450+0000 7fc7b5340640 1 Processor -- start 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.450+0000 7fc7b5340640 1 -- start start 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b00cecf0 0x7fc7b01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00d0630 0x7fc7b015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0161320 con 0x7fc7b015d5e0 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b00b6ca0 con 0x7fc7b00cecf0 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b015ff20 con 0x7fc7b00d0630 2024-04-16T12:55:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36396/0 (socket says 172.21.15.18:36396) 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 -- 172.21.15.18:0/238140990 learned_addr learned my addr 172.21.15.18:0/238140990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b00cecf0 0x7fc7b01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7a67fc640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00d0630 0x7fc7b015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 -- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00d0630 msgr2=0x7fc7b015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00d0630 0x7fc7b015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 -- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b00cecf0 msgr2=0x7fc7b01f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b00cecf0 0x7fc7b01f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 -- 172.21.15.18:0/238140990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b015f160 con 0x7fc7b015d5e0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7af7fe640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800ce80 tx=0x7fc7a800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a801a070 con 0x7fc7b015d5e0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a800d880 con 0x7fc7b015d5e0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b015f440 con 0x7fc7b015d5e0 2024-04-16T12:55:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.451+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800dc70 con 0x7fc7b015d5e0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.452+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b015fa00 con 0x7fc7b015d5e0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.452+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b00cb9a0 con 0x7fc7b015d5e0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.453+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc7a801d070 con 0x7fc7b015d5e0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.453+0000 7fc7a7fff640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 0x7fc79006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.453+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc7a808bf10 con 0x7fc7b015d5e0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.454+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 0x7fc79006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:06.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.454+0000 7fc7aeffd640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 0x7fc79006ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0036000 tx=0x7fc7a003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:06.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.458+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7b00cb9a0 con 0x7fc7b015d5e0 2024-04-16T12:55:06.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:06.642+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc7b0068a70 con 0x7fc7b015d5e0 2024-04-16T12:55:07.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.580+0000 7fc7a7fff640 1 -- 172.21.15.18:0/238140990 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fc7a805a040 con 0x7fc7b015d5e0 2024-04-16T12:55:07.582 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-16T12:55:07.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 msgr2=0x7fc79006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 0x7fc79006ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0036000 tx=0x7fc7a003c040 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 msgr2=0x7fc7b0159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800ce80 tx=0x7fc7a800a710 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 shutdown_connections 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc79006c920 0x7fc79006ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7b015d5e0 0x7fc7b0159be0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc7b00d0630 0x7fc7b015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 --2- 172.21.15.18:0/238140990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b00cecf0 0x7fc7b01f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 >> 172.21.15.18:0/238140990 conn(0x7fc7b009aa10 msgr2=0x7fc7b00af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:07.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 shutdown_connections 2024-04-16T12:55:07.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.585+0000 7fc7b5340640 1 -- 172.21.15.18:0/238140990 wait complete. 2024-04-16T12:55:07.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-16T12:55:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.718+0000 7fcd38b32640 1 Processor -- start 2024-04-16T12:55:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.718+0000 7fcd38b32640 1 -- start start 2024-04-16T12:55:07.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd38b32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:07.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd38b32640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd3415f100 con 0x7fcd340b6390 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd38b32640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340cfb30 con 0x7fcd340b3ec0 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd38b32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340cf740 con 0x7fcd3415ed20 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd32d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcd340b6390 0x7fcd340b7b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35440/0 (socket says 172.21.15.18:35440) 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd32d9d640 1 -- 172.21.15.18:0/3942307795 learned_addr learned my addr 172.21.15.18:0/3942307795 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.719+0000 7fcd3259c640 1 --2- 172.21.15.18:0/3942307795 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97978781 0 0) 0x7fcd3415f100 con 0x7fcd340b6390 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd20003520 con 0x7fcd340b6390 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457316309 0 0) 0x7fcd340cfb30 con 0x7fcd340b3ec0 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd3415f100 con 0x7fcd340b3ec0 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1141646605 0 0) 0x7fcd20003520 con 0x7fcd340b6390 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd3259c640 1 -- 172.21.15.18:0/3942307795 >> v1:172.21.15.104:6789/0 conn(0x7fcd340b3ec0 legacy=0x7fcd340d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd3259c640 1 -- 172.21.15.18:0/3942307795 >> v1:172.21.15.18:6789/0 conn(0x7fcd340b6390 legacy=0x7fcd340b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.720+0000 7fcd3259c640 1 -- 172.21.15.18:0/3942307795 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340cfe10 con 0x7fcd3415ed20 2024-04-16T12:55:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd3259c640 1 --2- 172.21.15.18:0/3942307795 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340cf200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd240097d0 tx=0x7fcd2402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17bbe342019ad113 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037070 con 0x7fcd3415ed20 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd24030510 con 0x7fcd3415ed20 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd31d9b640 1 -- 172.21.15.18:0/3942307795 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c001970 con 0x7fcd3415ed20 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 -- 172.21.15.18:0/3942307795 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 msgr2=0x7fcd340cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 --2- 172.21.15.18:0/3942307795 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340cf200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd240097d0 tx=0x7fcd2402b800 comp rx=0 tx=0).stop 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 -- 172.21.15.18:0/3942307795 shutdown_connections 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 --2- 172.21.15.18:0/3942307795 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340cf200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 -- 172.21.15.18:0/3942307795 >> 172.21.15.18:0/3942307795 conn(0x7fcd340d1390 msgr2=0x7fcd340d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 -- 172.21.15.18:0/3942307795 shutdown_connections 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.721+0000 7fcd38b32640 1 -- 172.21.15.18:0/3942307795 wait complete. 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 Processor -- start 2024-04-16T12:55:07.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 -- start start 2024-04-16T12:55:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd340b6390 0x7fcd340c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340d38e0 con 0x7fcd340b3ec0 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340cf8e0 con 0x7fcd340b6390 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.723+0000 7fcd38b32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340d00f0 con 0x7fcd3415ed20 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36404/0 (socket says 172.21.15.18:36404) 2024-04-16T12:55:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 -- 172.21.15.18:0/4049810003 learned_addr learned my addr 172.21.15.18:0/4049810003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd32d9d640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd2bfff640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd340b6390 0x7fcd340c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 -- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 msgr2=0x7fcd340ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 -- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd340b6390 msgr2=0x7fcd340c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd340b6390 0x7fcd340c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 -- 172.21.15.18:0/4049810003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd34158660 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd3259c640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402b840 tx=0x7fcd240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24042020 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd24038040 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037070 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd340ccfd0 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.724+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd340cd590 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.725+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd340752b0 con 0x7fcd340b3ec0 2024-04-16T12:55:07.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.726+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd24045020 con 0x7fcd340b3ec0 2024-04-16T12:55:07.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.726+0000 7fcd2affd640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 0x7fcd1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:07.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.726+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fcd240ad320 con 0x7fcd340b3ec0 2024-04-16T12:55:07.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.726+0000 7fcd2bfff640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 0x7fcd1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:07.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.727+0000 7fcd2bfff640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 0x7fcd1406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd340d5410 tx=0x7fcd1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:07.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.731+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd2404c030 con 0x7fcd340b3ec0 2024-04-16T12:55:07.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:07.914+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fcd340c7d90 con 0x7fcd340b3ec0 2024-04-16T12:55:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.584+0000 7fcd2affd640 1 -- 172.21.15.18:0/4049810003 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fcd2407b370 con 0x7fcd340b3ec0 2024-04-16T12:55:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-16T12:55:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.588+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 msgr2=0x7fcd1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.588+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 0x7fcd1406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd340d5410 tx=0x7fcd1c009040 comp rx=0 tx=0).stop 2024-04-16T12:55:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.588+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 msgr2=0x7fcd340caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.588+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402b840 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 shutdown_connections 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcd1406c8f0 0x7fcd1406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcd3415ed20 0x7fcd340ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd340b6390 0x7fcd340c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 --2- 172.21.15.18:0/4049810003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd340b3ec0 0x7fcd340caf90 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402b840 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.589+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 >> 172.21.15.18:0/4049810003 conn(0x7fcd340d1390 msgr2=0x7fcd340ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.592+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 shutdown_connections 2024-04-16T12:55:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.593+0000 7fcd38b32640 1 -- 172.21.15.18:0/4049810003 wait complete. 2024-04-16T12:55:08.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T12:55:08.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 Processor -- start 2024-04-16T12:55:08.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 -- start start 2024-04-16T12:55:08.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f278815ed20 0x7f27880cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278815f100 con 0x7f27880b3ec0 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f27880cf740 con 0x7f278815ed20 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.730+0000 7f278d8c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f27880cf8e0 con 0x7f27880b6390 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f27867fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27880b3ec0 0x7f27880d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35456/0 (socket says 172.21.15.18:35456) 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f27867fc640 1 -- 172.21.15.18:0/1171050219 learned_addr learned my addr 172.21.15.18:0/1171050219 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2786ffd640 1 --2- 172.21.15.18:0/1171050219 >> v2:172.21.15.104:3300/0 conn(0x7f278815ed20 0x7f27880cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f27877fe640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2785ffb640 1 -- 172.21.15.18:0/1171050219 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755436488 0 0) 0x7f278815f100 con 0x7f27880b3ec0 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2785ffb640 1 -- 172.21.15.18:0/1171050219 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2774003520 con 0x7f27880b3ec0 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2786ffd640 1 -- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 msgr2=0x7f27880b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2786ffd640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2786ffd640 1 -- 172.21.15.18:0/1171050219 >> v1:172.21.15.18:6789/0 conn(0x7f27880b3ec0 legacy=0x7f27880d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f2786ffd640 1 -- 172.21.15.18:0/1171050219 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27880cfb30 con 0x7f278815ed20 2024-04-16T12:55:08.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.731+0000 7f27877fe640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.732+0000 7f2786ffd640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278815ed20 0x7f27880cf200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2780009d90 tx=0x7f278002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0a9cbd3348204 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.732+0000 7f2785ffb640 1 -- 172.21.15.18:0/1171050219 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780039070 con 0x7f278815ed20 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.732+0000 7f2785ffb640 1 -- 172.21.15.18:0/1171050219 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278002cc50 con 0x7f278815ed20 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.732+0000 7f2785ffb640 1 -- 172.21.15.18:0/1171050219 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780034440 con 0x7f278815ed20 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 -- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278815ed20 msgr2=0x7f27880cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278815ed20 0x7f27880cf200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2780009d90 tx=0x7f278002bea0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 -- 172.21.15.18:0/1171050219 shutdown_connections 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 --2- 172.21.15.18:0/1171050219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278815ed20 0x7f27880cf200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 -- 172.21.15.18:0/1171050219 >> 172.21.15.18:0/1171050219 conn(0x7f27880d1390 msgr2=0x7f27880d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:08.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 -- 172.21.15.18:0/1171050219 shutdown_connections 2024-04-16T12:55:08.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.733+0000 7f278d8c8640 1 -- 172.21.15.18:0/1171050219 wait complete. 2024-04-16T12:55:08.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.734+0000 7f278d8c8640 1 Processor -- start 2024-04-16T12:55:08.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.734+0000 7f278d8c8640 1 -- start start 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27880b3ec0 0x7f27881536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27880d38e0 con 0x7f278815ed20 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27880d3600 con 0x7f27880b3ec0 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f27880d00f0 con 0x7f27880b6390 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36418/0 (socket says 172.21.15.18:36418) 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 -- 172.21.15.18:0/3270292424 learned_addr learned my addr 172.21.15.18:0/3270292424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27867fc640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f2786ffd640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27880b3ec0 0x7f27881536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 -- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 msgr2=0x7f27880b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 -- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27880b3ec0 msgr2=0x7f27881536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27880b3ec0 0x7f27881536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 -- 172.21.15.18:0/3270292424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27880cbaf0 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27867fc640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f27877fe640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f277800e880 tx=0x7f277800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778017070 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778004020 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.735+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27880cbdd0 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.736+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780043f0 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.736+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27880cc390 con 0x7f278815ed20 2024-04-16T12:55:08.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.737+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27880752b0 con 0x7f278815ed20 2024-04-16T12:55:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.737+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f277800c940 con 0x7f278815ed20 2024-04-16T12:55:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.737+0000 7f277ffff640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.737+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f277808bc80 con 0x7f278815ed20 2024-04-16T12:55:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.738+0000 7f2786ffd640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:08.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.738+0000 7f2786ffd640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 0x7f276806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f2780030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:08.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.742+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f277805a110 con 0x7f278815ed20 2024-04-16T12:55:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:08.968+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f27880ced30 con 0x7f278815ed20 2024-04-16T12:55:09.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.586+0000 7f277ffff640 1 -- 172.21.15.18:0/3270292424 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f2778059a10 con 0x7f278815ed20 2024-04-16T12:55:09.587 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T12:55:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.589+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 msgr2=0x7f276806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.589+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 0x7f276806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f2780030000 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 msgr2=0x7f27880c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f277800e880 tx=0x7f277800ed40 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 shutdown_connections 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f276806c8f0 0x7f276806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f278815ed20 0x7f27880c9f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27880b6390 0x7f27880b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 --2- 172.21.15.18:0/3270292424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27880b3ec0 0x7f27881536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.590+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 >> 172.21.15.18:0/3270292424 conn(0x7f27880d1390 msgr2=0x7f278815dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:09.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.593+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 shutdown_connections 2024-04-16T12:55:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.604+0000 7f278d8c8640 1 -- 172.21.15.18:0/3270292424 wait complete. 2024-04-16T12:55:09.627 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-16T12:55:09.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-16T12:55:09.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.738+0000 7f17e5275640 1 Processor -- start 2024-04-16T12:55:09.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.738+0000 7f17e5275640 1 -- start start 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e015eb10 0x7f17e00d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f17e00ba350 0x7f17e00b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17e00b6830 0x7f17e006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f17e00d3f30 con 0x7f17e00b6830 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f17e00ba790 con 0x7f17e00ba350 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17e5275640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f17e00d3320 con 0x7f17e015eb10 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17df7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17e00b6830 0x7f17e006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17df7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17e00b6830 0x7f17e006cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36426/0 (socket says 172.21.15.18:36426) 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17df7fe640 1 -- 172.21.15.18:0/2937477519 learned_addr learned my addr 172.21.15.18:0/2937477519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17de7fc640 1 --2- 172.21.15.18:0/2937477519 >> v2:172.21.15.104:3300/0 conn(0x7f17e00ba350 0x7f17e00b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.739+0000 7f17deffd640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e015eb10 0x7f17e00d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 -- 172.21.15.18:0/2937477519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e015eb10 msgr2=0x7f17e00d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e015eb10 0x7f17e00d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 -- 172.21.15.18:0/2937477519 >> v2:172.21.15.104:3300/0 conn(0x7f17e00ba350 msgr2=0x7f17e00b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 --2- 172.21.15.18:0/2937477519 >> v2:172.21.15.104:3300/0 conn(0x7f17e00ba350 0x7f17e00b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 -- 172.21.15.18:0/2937477519 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00d3600 con 0x7f17e00b6830 2024-04-16T12:55:09.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17df7fe640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e00b6830 0x7f17e006cdf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f17e006dec0 tx=0x7f17d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f618c1a1ce41ad66 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17ddffb640 1 -- 172.21.15.18:0/2937477519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d002ca70 con 0x7f17e00b6830 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.740+0000 7f17ddffb640 1 -- 172.21.15.18:0/2937477519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d002cc10 con 0x7f17e00b6830 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17ddffb640 1 -- 172.21.15.18:0/2937477519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d00343f0 con 0x7f17e00b6830 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 -- 172.21.15.18:0/2937477519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e00b6830 msgr2=0x7f17e006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e00b6830 0x7f17e006cdf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f17e006dec0 tx=0x7f17d002bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 -- 172.21.15.18:0/2937477519 shutdown_connections 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 --2- 172.21.15.18:0/2937477519 >> v2:172.21.15.104:3300/0 conn(0x7f17e00ba350 0x7f17e00b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e00b6830 0x7f17e006cdf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 --2- 172.21.15.18:0/2937477519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e015eb10 0x7f17e00d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 -- 172.21.15.18:0/2937477519 >> 172.21.15.18:0/2937477519 conn(0x7f17e006c0d0 msgr2=0x7f17e00d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 -- 172.21.15.18:0/2937477519 shutdown_connections 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.741+0000 7f17e5275640 1 -- 172.21.15.18:0/2937477519 wait complete. 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.742+0000 7f17e5275640 1 Processor -- start 2024-04-16T12:55:09.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.742+0000 7f17e5275640 1 -- start start 2024-04-16T12:55:09.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e00b6830 0x7f17e00ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e00ba350 0x7f17e015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00d43c0 con 0x7f17e015eb10 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00d3bc0 con 0x7f17e00b6830 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17e5275640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f17e00ce8b0 con 0x7f17e00ba350 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17df7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17df7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36438/0 (socket says 172.21.15.18:36438) 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17df7fe640 1 -- 172.21.15.18:0/1971059014 learned_addr learned my addr 172.21.15.18:0/1971059014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17de7fc640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e00ba350 0x7f17e015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.743+0000 7f17deffd640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e00b6830 0x7f17e00ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 -- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e00ba350 msgr2=0x7f17e015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e00ba350 0x7f17e015eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 -- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e00b6830 msgr2=0x7f17e00ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e00b6830 0x7f17e00ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:09.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 -- 172.21.15.18:0/1971059014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e015f430 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17df7fe640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009f40 tx=0x7f17d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0043020 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d003e450 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e00c9480 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0009510 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.744+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e00c9a40 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.745+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e00752b0 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.745+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17d0046020 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.746+0000 7f17d77fe640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.746+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f17d00ae010 con 0x7f17e015eb10 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.746+0000 7f17deffd640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:09.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.747+0000 7f17deffd640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 0x7f17c006ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009aa0 tx=0x7f17d8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:09.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.750+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17d004d030 con 0x7f17e015eb10 2024-04-16T12:55:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:09.942+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f17e00ba130 con 0x7f17e015eb10 2024-04-16T12:55:10.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.588+0000 7f17d77fe640 1 -- 172.21.15.18:0/1971059014 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f17d007be80 con 0x7f17e015eb10 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 msgr2=0x7f17c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 0x7f17c006ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009aa0 tx=0x7f17d8009190 comp rx=0 tx=0).stop 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 msgr2=0x7f17e015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009f40 tx=0x7f17d0004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 shutdown_connections 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e015eb10 0x7f17e015c1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f17e00ba350 0x7f17e015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 --2- 172.21.15.18:0/1971059014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e00b6830 0x7f17e00ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 >> 172.21.15.18:0/1971059014 conn(0x7f17e006c0d0 msgr2=0x7f17e00b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 shutdown_connections 2024-04-16T12:55:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.591+0000 7f17e5275640 1 -- 172.21.15.18:0/1971059014 wait complete. 2024-04-16T12:55:10.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.727+0000 7fd5bb7cd640 1 Processor -- start 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.727+0000 7fd5bb7cd640 1 -- start start 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5bb7cd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd5b415e900 0x7fd5b40d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5bb7cd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40d33f0 con 0x7fd5b40ba510 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5bb7cd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40d36d0 con 0x7fd5b40d1980 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5bb7cd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b40d39b0 con 0x7fd5b415e900 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b8d68640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd5b40ba510 0x7fd5b40d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35470/0 (socket says 172.21.15.18:35470) 2024-04-16T12:55:10.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b8d68640 1 -- 172.21.15.18:0/2808611945 learned_addr learned my addr 172.21.15.18:0/2808611945 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b9569640 1 --2- 172.21.15.18:0/2808611945 >> v2:172.21.15.104:3300/0 conn(0x7fd5b415e900 0x7fd5b40d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661455286 0 0) 0x7fd5b40d33f0 con 0x7fd5b40ba510 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5a0003520 con 0x7fd5b40ba510 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b9569640 1 -- 172.21.15.18:0/2808611945 >> v1:172.21.15.104:6789/0 conn(0x7fd5b40d1980 legacy=0x7fd5b40b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b9569640 1 -- 172.21.15.18:0/2808611945 >> v1:172.21.15.18:6789/0 conn(0x7fd5b40ba510 legacy=0x7fd5b40d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890658981 0 0) 0x7fd5a0003520 con 0x7fd5b40ba510 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.728+0000 7fd5b9569640 1 -- 172.21.15.18:0/2808611945 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40d3c90 con 0x7fd5b415e900 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.729+0000 7fd5b9569640 1 --2- 172.21.15.18:0/2808611945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b415e900 0x7fd5b40d2bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00097a0 tx=0x7fd5b002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=143e4b0a3a6866f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.729+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0038070 con 0x7fd5b415e900 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.729+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b0031500 con 0x7fd5b415e900 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.729+0000 7fd5abfff640 1 -- 172.21.15.18:0/2808611945 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4001670 con 0x7fd5b415e900 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2808611945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b415e900 msgr2=0x7fd5b40d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2808611945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b415e900 0x7fd5b40d2bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00097a0 tx=0x7fd5b002b820 comp rx=0 tx=0).stop 2024-04-16T12:55:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2808611945 shutdown_connections 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2808611945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b415e900 0x7fd5b40d2bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2808611945 >> 172.21.15.18:0/2808611945 conn(0x7fd5b406d490 msgr2=0x7fd5b40b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2808611945 shutdown_connections 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.730+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2808611945 wait complete. 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.731+0000 7fd5bb7cd640 1 Processor -- start 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.731+0000 7fd5bb7cd640 1 -- start start 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b40ba510 0x7fd5b4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 0x7fd5b41f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b415ece0 con 0x7fd5b415e900 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b40d3100 con 0x7fd5b40ba510 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5bb7cd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b415ee60 con 0x7fd5b40d1980 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36444/0 (socket says 172.21.15.18:36444) 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 -- 172.21.15.18:0/2290271391 learned_addr learned my addr 172.21.15.18:0/2290271391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9569640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b40ba510 0x7fd5b4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b8d68640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 0x7fd5b41f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 -- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 msgr2=0x7fd5b41f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 0x7fd5b41f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 -- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b40ba510 msgr2=0x7fd5b4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b40ba510 0x7fd5b4157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.732+0000 7fd5b9d6a640 1 -- 172.21.15.18:0/2290271391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40cc850 con 0x7fd5b415e900 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5b8d68640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 0x7fd5b41f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5b9d6a640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c7a0 tx=0x7fd5ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac003b70 con 0x7fd5b415e900 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b40ccae0 con 0x7fd5b415e900 2024-04-16T12:55:10.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ac003d30 con 0x7fd5b415e900 2024-04-16T12:55:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00aa90 con 0x7fd5b415e900 2024-04-16T12:55:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.733+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b40cd0a0 con 0x7fd5b415e900 2024-04-16T12:55:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.734+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b40752b0 con 0x7fd5b415e900 2024-04-16T12:55:10.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.734+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5ac00ac30 con 0x7fd5b415e900 2024-04-16T12:55:10.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.735+0000 7fd5a9ffb640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 0x7fd59806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:10.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.735+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fd5ac08bb70 con 0x7fd5b415e900 2024-04-16T12:55:10.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.735+0000 7fd5b9569640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 0x7fd59806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:10.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.736+0000 7fd5b9569640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 0x7fd59806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0035000 tx=0x7fd5b0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:10.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.739+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5ac059e80 con 0x7fd5b415e900 2024-04-16T12:55:10.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:10.923+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd5b40cb1c0 con 0x7fd5b415e900 2024-04-16T12:55:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.619+0000 7fd5a9ffb640 1 -- 172.21.15.18:0/2290271391 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fd5ac059780 con 0x7fd5b415e900 2024-04-16T12:55:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-04-16T12:55:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 msgr2=0x7fd59806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 0x7fd59806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0035000 tx=0x7fd5b0008030 comp rx=0 tx=0).stop 2024-04-16T12:55:12.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 msgr2=0x7fd5b40cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c7a0 tx=0x7fd5ac00cc60 comp rx=0 tx=0).stop 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 shutdown_connections 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd59806c8f0 0x7fd59806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5b415e900 0x7fd5b40cc310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd5b40d1980 0x7fd5b41f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 --2- 172.21.15.18:0/2290271391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b40ba510 0x7fd5b4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 >> 172.21.15.18:0/2290271391 conn(0x7fd5b406d490 msgr2=0x7fd5b415d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 shutdown_connections 2024-04-16T12:55:12.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.623+0000 7fd5bb7cd640 1 -- 172.21.15.18:0/2290271391 wait complete. 2024-04-16T12:55:12.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-16T12:55:12.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.755+0000 7f5aa8a42640 1 Processor -- start 2024-04-16T12:55:12.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.755+0000 7f5aa8a42640 1 -- start start 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa8a42640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5aa415eb10 0x7f5aa40d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa8a42640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa40ba790 con 0x7f5aa40b6a00 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa8a42640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa40d3320 con 0x7f5aa40ba350 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa8a42640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa40d3f30 con 0x7f5aa415eb10 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa2d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5aa40b6a00 0x7f5aa40b79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35482/0 (socket says 172.21.15.18:35482) 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa2d9d640 1 -- 172.21.15.18:0/2742166462 learned_addr learned my addr 172.21.15.18:0/2742166462 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577673670 0 0) 0x7f5aa40ba790 con 0x7f5aa40b6a00 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a90003520 con 0x7f5aa40b6a00 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.756+0000 7f5aa259c640 1 --2- 172.21.15.18:0/2742166462 >> v2:172.21.15.104:3300/0 conn(0x7f5aa415eb10 0x7f5aa40d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1565497396 0 0) 0x7f5a90003520 con 0x7f5aa40b6a00 2024-04-16T12:55:12.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 >> v2:172.21.15.104:3300/0 conn(0x7f5aa415eb10 msgr2=0x7f5aa40d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 --2- 172.21.15.18:0/2742166462 >> v2:172.21.15.104:3300/0 conn(0x7f5aa415eb10 0x7f5aa40d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 >> v1:172.21.15.104:6789/0 conn(0x7f5aa40ba350 legacy=0x7f5aa40b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa40d3600 con 0x7f5aa40b6a00 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f5a94001670 con 0x7f5aa40b6a00 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 >> v1:172.21.15.18:6789/0 conn(0x7f5aa40b6a00 legacy=0x7f5aa40b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900039b0 0x7f5a90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a90004800 0x7f5a90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 0x7f5a9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40d3f30 con 0x7f5a900051c0 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9000c060 con 0x7f5a900039b0 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9000c260 con 0x7f5a90004800 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 0x7f5a9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa259c640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900039b0 0x7f5a90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa1d9b640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a90004800 0x7f5a90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 -- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a90004800 msgr2=0x7f5a90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a90004800 0x7f5a90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 -- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900039b0 msgr2=0x7f5a90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900039b0 0x7f5a90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa2d9d640 1 -- 172.21.15.18:0/2742166462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a90003520 con 0x7f5a900051c0 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.757+0000 7f5aa259c640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900039b0 0x7f5a90003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.758+0000 7f5aa2d9d640 1 -- 172.21.15.18:0/2742166462 reap_dead start 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.758+0000 7f5aa2d9d640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 0x7f5a9000b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa41624a0 tx=0x7f5a90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfc1ca94d8ecbbf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.758+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c009c10 con 0x7f5a900051c0 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.758+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a94030070 con 0x7f5a900051c0 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.758+0000 7f5aa159a640 1 -- 172.21.15.18:0/2742166462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007cf0 con 0x7f5a900051c0 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 -- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 msgr2=0x7f5a9000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 0x7f5a9000b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa41624a0 tx=0x7f5a90005830 comp rx=0 tx=0).stop 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 -- 172.21.15.18:0/2742166462 shutdown_connections 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/2742166462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a900051c0 0x7f5a9000b9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 -- 172.21.15.18:0/2742166462 >> 172.21.15.18:0/2742166462 conn(0x7f5aa406c0d0 msgr2=0x7f5aa40d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:12.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 -- 172.21.15.18:0/2742166462 shutdown_connections 2024-04-16T12:55:12.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.759+0000 7f5aa8a42640 1 -- 172.21.15.18:0/2742166462 wait complete. 2024-04-16T12:55:12.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.760+0000 7f5aa8a42640 1 Processor -- start 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.760+0000 7f5aa8a42640 1 -- start start 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900051c0 0x7f5aa40b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5aa41e45b0 0x7f5aa41e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40d43c0 con 0x7f5aa4150880 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40d3bc0 con 0x7f5a900051c0 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa8a42640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa4151240 con 0x7f5aa41e45b0 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36462/0 (socket says 172.21.15.18:36462) 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 -- 172.21.15.18:0/1057707741 learned_addr learned my addr 172.21.15.18:0/1057707741 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa259c640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900051c0 0x7f5aa40b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa2d9d640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5aa41e45b0 0x7f5aa41e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 -- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5aa41e45b0 msgr2=0x7f5aa41e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5aa41e45b0 0x7f5aa41e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 -- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900051c0 msgr2=0x7f5aa40b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900051c0 0x7f5aa40b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 -- 172.21.15.18:0/1057707741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa41e5320 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.761+0000 7f5aa1d9b640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00f5f0 tx=0x7f5a8c00f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.762+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0052e0 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.762+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8c018070 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.762+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c003810 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.762+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa41e5600 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.762+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa41e5bc0 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.763+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa40752b0 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.763+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a8c0039b0 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.764+0000 7f5a9affd640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 0x7f5a8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.764+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f5a8c08ba60 con 0x7f5aa4150880 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.764+0000 7f5aa259c640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 0x7f5a8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.764+0000 7f5aa259c640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 0x7f5a8406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5aa415e1a0 tx=0x7f5a9c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.768+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a8c059c00 con 0x7f5aa4150880 2024-04-16T12:55:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:12.952+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f5aa40b66c0 con 0x7f5aa4150880 2024-04-16T12:55:13.111 INFO:tasks.ceph.mds.b.smithi104.stderr:2024-04-16T12:55:13.110+0000 7fde995ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:55:13.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.621+0000 7f5a9affd640 1 -- 172.21.15.18:0/1057707741 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f5a8c059500 con 0x7f5aa4150880 2024-04-16T12:55:13.623 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 msgr2=0x7f5a8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 0x7f5a8406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5aa415e1a0 tx=0x7f5a9c00b040 comp rx=0 tx=0).stop 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 msgr2=0x7f5aa4150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00f5f0 tx=0x7f5a8c00f9f0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 shutdown_connections 2024-04-16T12:55:13.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a8406c8f0 0x7f5a8406edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5aa41e45b0 0x7f5aa41e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa4150880 0x7f5aa4150d00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.626+0000 7f5aa8a42640 1 --2- 172.21.15.18:0/1057707741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a900051c0 0x7f5aa40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.627+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 >> 172.21.15.18:0/1057707741 conn(0x7f5aa406c0d0 msgr2=0x7f5aa40b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.627+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 shutdown_connections 2024-04-16T12:55:13.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.628+0000 7f5aa8a42640 1 -- 172.21.15.18:0/1057707741 wait complete. 2024-04-16T12:55:13.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-16T12:55:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.769+0000 7f2966b59640 1 Processor -- start 2024-04-16T12:55:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.769+0000 7f2966b59640 1 -- start start 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f2966b59640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29600b3ec0 0x7f29600cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f2966b59640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296015f100 con 0x7f296015ed20 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f2966b59640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29600cfb30 con 0x7f29600b6390 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f2966b59640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f29600cf740 con 0x7f29600b3ec0 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29648f5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f296015ed20 0x7f29600d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38942/0 (socket says 172.21.15.18:38942) 2024-04-16T12:55:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29648f5640 1 -- 172.21.15.18:0/3983400268 learned_addr learned my addr 172.21.15.18:0/3983400268 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f2957fff640 1 --2- 172.21.15.18:0/3983400268 >> v2:172.21.15.104:3300/0 conn(0x7f29600b3ec0 0x7f29600cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786325275 0 0) 0x7f296015f100 con 0x7f296015ed20 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948003520 con 0x7f296015ed20 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1647017394 0 0) 0x7f2948003520 con 0x7f296015ed20 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 >> v2:172.21.15.104:3300/0 conn(0x7f29600b3ec0 msgr2=0x7f29600cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 --2- 172.21.15.18:0/3983400268 >> v2:172.21.15.104:3300/0 conn(0x7f29600b3ec0 0x7f29600cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 >> v1:172.21.15.104:6789/0 conn(0x7f29600b6390 legacy=0x7f29600b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29600cfe10 con 0x7f296015ed20 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f295c001670 con 0x7f296015ed20 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 >> v1:172.21.15.18:6789/0 conn(0x7f296015ed20 legacy=0x7f29600d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.770+0000 7f29577fe640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480039b0 0x7f2948003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29577fe640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2948004800 0x7f2948004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29577fe640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 0x7f294800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29600cf740 con 0x7f29480051c0 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f294800c060 con 0x7f2948004800 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f294800c260 con 0x7f29480039b0 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 0x7f294800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f2957fff640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2948004800 0x7f2948004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29648f5640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480039b0 0x7f2948003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 -- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480039b0 msgr2=0x7f2948003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480039b0 0x7f2948003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 -- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2948004800 msgr2=0x7f2948004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:13.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2948004800 0x7f2948004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f29650f6640 1 -- 172.21.15.18:0/3983400268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948003520 con 0x7f29480051c0 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.771+0000 7f2957fff640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2948004800 0x7f2948004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f29650f6640 1 -- 172.21.15.18:0/3983400268 reap_dead start 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f29650f6640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 0x7f294800b9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2958001e50 tx=0x7f2948005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c9f939532044d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2950009690 con 0x7f29480051c0 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958003bb0 con 0x7f29480051c0 2024-04-16T12:55:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f29577fe640 1 -- 172.21.15.18:0/3983400268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958001a70 con 0x7f29480051c0 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 -- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 msgr2=0x7f294800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 0x7f294800b9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2958001e50 tx=0x7f2948005830 comp rx=0 tx=0).stop 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 -- 172.21.15.18:0/3983400268 shutdown_connections 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 --2- 172.21.15.18:0/3983400268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29480051c0 0x7f294800b9c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 -- 172.21.15.18:0/3983400268 >> 172.21.15.18:0/3983400268 conn(0x7f29600d1390 msgr2=0x7f29600d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 -- 172.21.15.18:0/3983400268 shutdown_connections 2024-04-16T12:55:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.772+0000 7f2966b59640 1 -- 172.21.15.18:0/3983400268 wait complete. 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.774+0000 7f2966b59640 1 Processor -- start 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.774+0000 7f2966b59640 1 -- start start 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.774+0000 7f2966b59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 0x7f29600cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.774+0000 7f2966b59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 0x7f29601f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2966b59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2966b59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29600d38e0 con 0x7f29601f42d0 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2966b59640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f29600cf8e0 con 0x7f2960161aa0 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2966b59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f29600d00f0 con 0x7f29480051c0 2024-04-16T12:55:13.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29650f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 0x7f29600cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2957fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 0x7f29601f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29650f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43370/0 (socket says 172.21.15.18:43370) 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29650f6640 1 -- 172.21.15.18:0/3531932968 learned_addr learned my addr 172.21.15.18:0/3531932968 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 -- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 msgr2=0x7f29601f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 0x7f29601f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 -- 172.21.15.18:0/3531932968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 msgr2=0x7f29601f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 -- 172.21.15.18:0/3531932968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29600cdfc0 con 0x7f29480051c0 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2957fff640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 0x7f29601f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29650f6640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:13.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29648f5640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 0x7f29600cbba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f295c007290 tx=0x7f295c007690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c00f8e0 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c018070 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c00fce0 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.775+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29600ce2a0 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.776+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29600ce860 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.777+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29600752b0 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.777+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f295c01d460 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.777+0000 7f29557fa640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.778+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f295c08bd70 con 0x7f29480051c0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.778+0000 7f2957fff640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:13.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.778+0000 7f2957fff640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 0x7f294c06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f296006c840 tx=0x7f2950009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:13.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:13.783+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f295c059e00 con 0x7f29480051c0 2024-04-16T12:55:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.011+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f296015e270 con 0x7f29480051c0 2024-04-16T12:55:14.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.637+0000 7f29557fa640 1 -- 172.21.15.18:0/3531932968 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f295c059700 con 0x7f29480051c0 2024-04-16T12:55:14.639 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 msgr2=0x7f294c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 0x7f294c06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f296006c840 tx=0x7f2950009190 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 msgr2=0x7f29600cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 0x7f29600cbba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f295c007290 tx=0x7f295c007690 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 shutdown_connections 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29601f42d0 0x7f29601f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2960161aa0 0x7f29601f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 --2- 172.21.15.18:0/3531932968 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29480051c0 0x7f29600cbba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 >> 172.21.15.18:0/3531932968 conn(0x7f29600d1390 msgr2=0x7f29600b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 shutdown_connections 2024-04-16T12:55:14.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.640+0000 7f2966b59640 1 -- 172.21.15.18:0/3531932968 wait complete. 2024-04-16T12:55:14.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:14.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.764+0000 7fcc047d4640 1 Processor -- start 2024-04-16T12:55:14.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.764+0000 7fcc047d4640 1 -- start start 2024-04-16T12:55:14.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc047d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcbfc0d1740 0x7fcbfc09b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc047d4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbfc070e10 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc047d4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbfc0d21a0 con 0x7fcbfc071400 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc047d4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fcbfc0d2480 con 0x7fcbfc0d1740 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc02d71640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcbfc09aa10 0x7fcbfc06d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38950/0 (socket says 172.21.15.18:38950) 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc02d71640 1 -- 172.21.15.18:0/3264120577 learned_addr learned my addr 172.21.15.18:0/3264120577 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc02570640 1 --2- 172.21.15.18:0/3264120577 >> v2:172.21.15.104:3300/0 conn(0x7fcbfc0d1740 0x7fcbfc09b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535901121 0 0) 0x7fcbfc070e10 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.765+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe4003520 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910569341 0 0) 0x7fcbe4003520 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 >> v2:172.21.15.104:3300/0 conn(0x7fcbfc0d1740 msgr2=0x7fcbfc09b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 --2- 172.21.15.18:0/3264120577 >> v2:172.21.15.104:3300/0 conn(0x7fcbfc0d1740 0x7fcbfc09b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 >> v1:172.21.15.104:6789/0 conn(0x7fcbfc071400 legacy=0x7fcbfc0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc0710b0 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fcbec0019f0 con 0x7fcbfc09aa10 2024-04-16T12:55:14.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 >> v1:172.21.15.18:6789/0 conn(0x7fcbfc09aa10 legacy=0x7fcbfc06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40039b0 0x7fcbe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbe4004800 0x7fcbe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 0x7fcbe400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc0d2480 con 0x7fcbe40051c0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe400c060 con 0x7fcbe4004800 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe400c260 con 0x7fcbe40039b0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 0x7fcbe400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02570640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40039b0 0x7fcbe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc01d6f640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbe4004800 0x7fcbe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 -- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40039b0 msgr2=0x7fcbe4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40039b0 0x7fcbe4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 -- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbe4004800 msgr2=0x7fcbe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbe4004800 0x7fcbe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc02d71640 1 -- 172.21.15.18:0/3264120577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe4003520 con 0x7fcbe40051c0 2024-04-16T12:55:14.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.766+0000 7fcc01d6f640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbe4004800 0x7fcbe4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc02d71640 1 -- 172.21.15.18:0/3264120577 reap_dead start 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc02d71640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 0x7fcbe400b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00a840 tx=0x7fcbe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8744cb3750d3e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00a460 con 0x7fcbe40051c0 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec034650 con 0x7fcbe40051c0 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc0156e640 1 -- 172.21.15.18:0/3264120577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec034a40 con 0x7fcbe40051c0 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc047d4640 1 -- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 msgr2=0x7fcbe400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.767+0000 7fcc047d4640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 0x7fcbe400b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00a840 tx=0x7fcbe4005830 comp rx=0 tx=0).stop 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.768+0000 7fcc047d4640 1 -- 172.21.15.18:0/3264120577 shutdown_connections 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.768+0000 7fcc047d4640 1 --2- 172.21.15.18:0/3264120577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe40051c0 0x7fcbe400b9c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.768+0000 7fcc047d4640 1 -- 172.21.15.18:0/3264120577 >> 172.21.15.18:0/3264120577 conn(0x7fcbfc0d2600 msgr2=0x7fcbfc0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.768+0000 7fcc047d4640 1 -- 172.21.15.18:0/3264120577 shutdown_connections 2024-04-16T12:55:14.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.768+0000 7fcc047d4640 1 -- 172.21.15.18:0/3264120577 wait complete. 2024-04-16T12:55:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.769+0000 7fcc047d4640 1 Processor -- start 2024-04-16T12:55:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.769+0000 7fcc047d4640 1 -- start start 2024-04-16T12:55:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40051c0 0x7fcbfc146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbfc15a6f0 0x7fcbfc1f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc0d1b20 con 0x7fcbfc15ab70 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc0720c0 con 0x7fcbfc15a6f0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc09b750 con 0x7fcbe40051c0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43384/0 (socket says 172.21.15.18:43384) 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 -- 172.21.15.18:0/478202060 learned_addr learned my addr 172.21.15.18:0/478202060 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc01d6f640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbfc15a6f0 0x7fcbfc1f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02570640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40051c0 0x7fcbfc146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 -- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40051c0 msgr2=0x7fcbfc146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40051c0 0x7fcbfc146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 -- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbfc15a6f0 msgr2=0x7fcbfc1f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbfc15a6f0 0x7fcbfc1f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 -- 172.21.15.18:0/478202060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc1e9600 con 0x7fcbfc15ab70 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc02d71640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f80 tx=0x7fcbfc0d2370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec001fb0 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec042070 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0019b0 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc15ce00 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.770+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc15d0a0 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.772+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbfc0752b0 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.772+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbec03c070 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.772+0000 7fcbfaffd640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 0x7fcbe806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.772+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcbec0ad5d0 con 0x7fcbfc15ab70 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.773+0000 7fcc02570640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 0x7fcbe806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:14.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.773+0000 7fcc02570640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 0x7fcbe806ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009b40 tx=0x7fcbf4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:14.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:14.777+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcbec07b070 con 0x7fcbfc15ab70 2024-04-16T12:55:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.001+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbfc0cfe70 con 0x7fcbfc15ab70 2024-04-16T12:55:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.002+0000 7fcbfaffd640 1 -- 172.21.15.18:0/478202060 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5189 (secure 0 0 0) 0x7fcbec07f370 con 0x7fcbfc15ab70 2024-04-16T12:55:15.006 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:15.006 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:14.013121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-16T12:55:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 msgr2=0x7fcbe806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 0x7fcbe806ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009b40 tx=0x7fcbf4009190 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 msgr2=0x7fcbfc1f8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f80 tx=0x7fcbfc0d2370 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 shutdown_connections 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcbe806c920 0x7fcbe806ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbfc15ab70 0x7fcbfc1f8640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbfc15a6f0 0x7fcbfc1f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 --2- 172.21.15.18:0/478202060 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcbe40051c0 0x7fcbfc146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.003+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 >> 172.21.15.18:0/478202060 conn(0x7fcbfc0d2600 msgr2=0x7fcbfc0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.004+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 shutdown_connections 2024-04-16T12:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.004+0000 7fcc047d4640 1 -- 172.21.15.18:0/478202060 wait complete. 2024-04-16T12:55:15.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:15.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.118+0000 7f9b97a75640 1 Processor -- start 2024-04-16T12:55:15.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 -- start start 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b900ceb70 0x7f9b900b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b90162c20 con 0x7f9b9015ea60 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9b90162f00 con 0x7f9b900ceb70 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b97a75640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b901631e0 con 0x7f9b900b48c0 2024-04-16T12:55:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b95010640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b900ceb70 0x7f9b900b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b95010640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b900ceb70 0x7f9b900b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43394/0 (socket says 172.21.15.18:43394) 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.119+0000 7f9b95010640 1 -- 172.21.15.18:0/2725621157 learned_addr learned my addr 172.21.15.18:0/2725621157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b96012640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b95010640 1 -- 172.21.15.18:0/2725621157 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 msgr2=0x7f9b900b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b95010640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b95010640 1 -- 172.21.15.18:0/2725621157 >> v1:172.21.15.18:6789/0 conn(0x7f9b9015ea60 legacy=0x7f9b900b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b95010640 1 -- 172.21.15.18:0/2725621157 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901634c0 con 0x7f9b900ceb70 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.120+0000 7f9b95010640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b900b6ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009870 tx=0x7f9b8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52c7462fe6b043c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b9480f640 1 -- 172.21.15.18:0/2725621157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80034070 con 0x7f9b900ceb70 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b9480f640 1 -- 172.21.15.18:0/2725621157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b80030840 con 0x7f9b900ceb70 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b9480f640 1 -- 172.21.15.18:0/2725621157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80030c10 con 0x7f9b900ceb70 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 -- 172.21.15.18:0/2725621157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 msgr2=0x7f9b900b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b900b6ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009870 tx=0x7f9b8002b980 comp rx=0 tx=0).stop 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 -- 172.21.15.18:0/2725621157 shutdown_connections 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2725621157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b900b6ca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 -- 172.21.15.18:0/2725621157 >> 172.21.15.18:0/2725621157 conn(0x7f9b900cf1b0 msgr2=0x7f9b900cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 -- 172.21.15.18:0/2725621157 shutdown_connections 2024-04-16T12:55:15.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.121+0000 7f9b97a75640 1 -- 172.21.15.18:0/2725621157 wait complete. 2024-04-16T12:55:15.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.122+0000 7f9b97a75640 1 Processor -- start 2024-04-16T12:55:15.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.122+0000 7f9b97a75640 1 -- start start 2024-04-16T12:55:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 0x7f9b901f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015efc0 con 0x7f9b900ceb70 2024-04-16T12:55:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015ee40 con 0x7f9b9015ea60 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b97a75640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b900d0300 con 0x7f9b900b48c0 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b95010640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b95010640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43402/0 (socket says 172.21.15.18:43402) 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b95010640 1 -- 172.21.15.18:0/2110874029 learned_addr learned my addr 172.21.15.18:0/2110874029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b96012640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 0x7f9b901f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.123+0000 7f9b95811640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 -- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 msgr2=0x7f9b900c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 -- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 msgr2=0x7f9b901f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 0x7f9b901f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 -- 172.21.15.18:0/2110874029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901f7ef0 con 0x7f9b900ceb70 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b96012640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 0x7f9b901f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95811640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b95010640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000c00 tx=0x7f9b80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80048070 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b80030640 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b900c9390 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80034040 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.124+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9006d9d0 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.125+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b90068a70 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.125+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b8004b070 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.126+0000 7f9b867fc640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 0x7f9b7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.126+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9b800addb0 con 0x7f9b900ceb70 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.126+0000 7f9b95811640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 0x7f9b7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.127+0000 7f9b95811640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 0x7f9b7406ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0015e0 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.130+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b80030810 con 0x7f9b900ceb70 2024-04-16T12:55:15.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.318+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b9006fd30 con 0x7f9b900ceb70 2024-04-16T12:55:15.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.319+0000 7f9b867fc640 1 -- 172.21.15.18:0/2110874029 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f9b8007bf30 con 0x7f9b900ceb70 2024-04-16T12:55:15.321 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:15.321 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:15.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 msgr2=0x7f9b7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 0x7f9b7406ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0015e0 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 msgr2=0x7f9b9006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000c00 tx=0x7f9b80004730 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 shutdown_connections 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b7406c920 0x7f9b7406ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b9015ea60 0x7f9b901f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b900ceb70 0x7f9b9006cb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 --2- 172.21.15.18:0/2110874029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b900b48c0 0x7f9b900c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 >> 172.21.15.18:0/2110874029 conn(0x7f9b900cf1b0 msgr2=0x7f9b9015f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 shutdown_connections 2024-04-16T12:55:15.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.321+0000 7f9b97a75640 1 -- 172.21.15.18:0/2110874029 wait complete. 2024-04-16T12:55:15.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:15.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.436+0000 7f2938fcd640 1 Processor -- start 2024-04-16T12:55:15.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.436+0000 7f2938fcd640 1 -- start start 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2938fcd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f293415ef70 0x7f293406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2938fcd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29340d01b0 con 0x7f29340b3a00 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2938fcd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2934163480 con 0x7f29340d3ed0 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2938fcd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f293415f350 con 0x7f293415ef70 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f293259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f293415ef70 0x7f293406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2931d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f29340b3a00 0x7f29340cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38968/0 (socket says 172.21.15.18:38968) 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f2931d9b640 1 -- 172.21.15.18:0/2009913203 learned_addr learned my addr 172.21.15.18:0/2009913203 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f293259c640 1 -- 172.21.15.18:0/2009913203 >> v1:172.21.15.104:6789/0 conn(0x7f29340d3ed0 legacy=0x7f29340cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f293259c640 1 -- 172.21.15.18:0/2009913203 >> v1:172.21.15.18:6789/0 conn(0x7f29340b3a00 legacy=0x7f29340cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f293259c640 1 -- 172.21.15.18:0/2009913203 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2934163760 con 0x7f293415ef70 2024-04-16T12:55:15.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.437+0000 7f293159a640 1 -- 172.21.15.18:0/2009913203 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297899075 0 0) 0x7f29340d01b0 con 0x7f29340b3a00 2024-04-16T12:55:15.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.438+0000 7f293259c640 1 --2- 172.21.15.18:0/2009913203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f293406ba20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f292402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccd85933ec6ec96 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.438+0000 7f293159a640 1 -- 172.21.15.18:0/2009913203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924034070 con 0x7f293415ef70 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.438+0000 7f293159a640 1 -- 172.21.15.18:0/2009913203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2924030610 con 0x7f293415ef70 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.438+0000 7f293159a640 1 -- 172.21.15.18:0/2009913203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29240309e0 con 0x7f293415ef70 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 -- 172.21.15.18:0/2009913203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 msgr2=0x7f293406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 --2- 172.21.15.18:0/2009913203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f293406ba20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f292402b960 comp rx=0 tx=0).stop 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 -- 172.21.15.18:0/2009913203 shutdown_connections 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 --2- 172.21.15.18:0/2009913203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f293406ba20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 -- 172.21.15.18:0/2009913203 >> 172.21.15.18:0/2009913203 conn(0x7f29340b69e0 msgr2=0x7f29340d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 -- 172.21.15.18:0/2009913203 shutdown_connections 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.439+0000 7f2938fcd640 1 -- 172.21.15.18:0/2009913203 wait complete. 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.440+0000 7f2938fcd640 1 Processor -- start 2024-04-16T12:55:15.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.440+0000 7f2938fcd640 1 -- start start 2024-04-16T12:55:15.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 0x7f2934161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 0x7f29340ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29340d2a30 con 0x7f293415ef70 2024-04-16T12:55:15.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f29340d2470 con 0x7f29340b3a00 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2938fcd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f29340d5160 con 0x7f29340d3ed0 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43424/0 (socket says 172.21.15.18:43424) 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 -- 172.21.15.18:0/4837761 learned_addr learned my addr 172.21.15.18:0/4837761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f293259c640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 0x7f2934161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2931d9b640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 0x7f29340ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 -- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 msgr2=0x7f29340ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 0x7f29340ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 -- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 msgr2=0x7f2934161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 0x7f2934161b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 -- 172.21.15.18:0/4837761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29341586e0 con 0x7f293415ef70 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2931d9b640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 0x7f29340ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f293259c640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 0x7f2934161b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:15.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.441+0000 7f2932d9d640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c6b0 tx=0x7f292c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.442+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c003b70 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.442+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c003d30 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.442+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2934158980 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.442+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c005310 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.442+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2934158f40 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.443+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29340752b0 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.443+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f292c0054b0 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.443+0000 7f2922ffd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 0x7f291406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.444+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f292c08bc60 con 0x7f293415ef70 2024-04-16T12:55:15.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.444+0000 7f293259c640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 0x7f291406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.444+0000 7f293259c640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 0x7f291406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2924036000 tx=0x7f292403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.448+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f292c059de0 con 0x7f293415ef70 2024-04-16T12:55:15.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.633+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29340d1100 con 0x7f293415ef70 2024-04-16T12:55:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.634+0000 7f2922ffd640 1 -- 172.21.15.18:0/4837761 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f292c0596e0 con 0x7f293415ef70 2024-04-16T12:55:15.636 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:15.636 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 msgr2=0x7f291406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 0x7f291406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2924036000 tx=0x7f292403b040 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 msgr2=0x7f29340cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c6b0 tx=0x7f292c00cb70 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 shutdown_connections 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291406c8f0 0x7f291406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293415ef70 0x7f29340cace0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29340d3ed0 0x7f29340ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 --2- 172.21.15.18:0/4837761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29340b3a00 0x7f2934161b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 >> 172.21.15.18:0/4837761 conn(0x7f29340b69e0 msgr2=0x7f29340b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 shutdown_connections 2024-04-16T12:55:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.636+0000 7f2938fcd640 1 -- 172.21.15.18:0/4837761 wait complete. 2024-04-16T12:55:15.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:15.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.769+0000 7f2c49524640 1 Processor -- start 2024-04-16T12:55:15.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.769+0000 7f2c49524640 1 -- start start 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c49524640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c4415ef70 0x7f2c4406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c49524640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2c440d3c80 0x7f2c4406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c49524640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c440cfe40 con 0x7f2c440b3ea0 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c49524640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2c440d0120 con 0x7f2c440d3c80 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c49524640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440d2470 con 0x7f2c4415ef70 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c427fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2c440b3ea0 0x7f2c441628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38984/0 (socket says 172.21.15.18:38984) 2024-04-16T12:55:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c427fc640 1 -- 172.21.15.18:0/4107120685 learned_addr learned my addr 172.21.15.18:0/4107120685 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707344809 0 0) 0x7f2c440cfe40 con 0x7f2c440b3ea0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c437fe640 1 --2- 172.21.15.18:0/4107120685 >> v2:172.21.15.104:3300/0 conn(0x7f2c440d3c80 0x7f2c4406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c4415ef70 0x7f2c4406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c30003520 con 0x7f2c440b3ea0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3136778325 0 0) 0x7f2c30003520 con 0x7f2c440b3ea0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c4415ef70 msgr2=0x7f2c4406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c4415ef70 0x7f2c4406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 >> v2:172.21.15.104:3300/0 conn(0x7f2c440d3c80 msgr2=0x7f2c4406bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 --2- 172.21.15.18:0/4107120685 >> v2:172.21.15.104:3300/0 conn(0x7f2c440d3c80 0x7f2c4406bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c440d2750 con 0x7f2c440b3ea0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f2c2c001670 con 0x7f2c440b3ea0 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 >> v1:172.21.15.18:6789/0 conn(0x7f2c440b3ea0 legacy=0x7f2c441628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c300039b0 0x7f2c30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c30004800 0x7f2c30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c30005180 0x7f2c3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d0120 con 0x7f2c300039b0 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.770+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d2470 con 0x7f2c30005180 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2c30004600 con 0x7f2c30004800 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c300039b0 0x7f2c30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c427fc640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c30004800 0x7f2c30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c437fe640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c30005180 0x7f2c3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 -- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c30004800 msgr2=0x7f2c30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c30004800 0x7f2c30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 -- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c30005180 msgr2=0x7f2c3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c30005180 0x7f2c3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c42ffd640 1 -- 172.21.15.18:0/4107120685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c30003520 con 0x7f2c300039b0 2024-04-16T12:55:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.771+0000 7f2c437fe640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c30005180 0x7f2c3000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c300039b0 0x7f2c30003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009ac0 tx=0x7f2c30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc42730fac4db21 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c039070 con 0x7f2c300039b0 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02c6b0 con 0x7f2c300039b0 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c41ffb640 1 -- 172.21.15.18:0/4107120685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c009690 con 0x7f2c300039b0 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 -- 172.21.15.18:0/4107120685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c300039b0 msgr2=0x7f2c30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 --2- 172.21.15.18:0/4107120685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c300039b0 0x7f2c30003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009ac0 tx=0x7f2c30005830 comp rx=0 tx=0).stop 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c437fe640 1 -- 172.21.15.18:0/4107120685 reap_dead start 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 -- 172.21.15.18:0/4107120685 shutdown_connections 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 -- 172.21.15.18:0/4107120685 >> 172.21.15.18:0/4107120685 conn(0x7f2c440b69e0 msgr2=0x7f2c440d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 -- 172.21.15.18:0/4107120685 shutdown_connections 2024-04-16T12:55:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.772+0000 7f2c49524640 1 -- 172.21.15.18:0/4107120685 wait complete. 2024-04-16T12:55:15.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 Processor -- start 2024-04-16T12:55:15.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 -- start start 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c300039b0 0x7f2c4414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c440ca910 0x7f2c44161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440b3510 con 0x7f2c44154940 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440b3390 con 0x7f2c440ca910 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.774+0000 7f2c49524640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440b3690 con 0x7f2c300039b0 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43428/0 (socket says 172.21.15.18:43428) 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 -- 172.21.15.18:0/416769276 learned_addr learned my addr 172.21.15.18:0/416769276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c300039b0 0x7f2c4414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c427fc640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c440ca910 0x7f2c44161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 -- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c300039b0 msgr2=0x7f2c4414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c300039b0 0x7f2c4414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 -- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c440ca910 msgr2=0x7f2c44161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c440ca910 0x7f2c44161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 -- 172.21.15.18:0/416769276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441615d0 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c437fe640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009ed0 tx=0x7f2c340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011de0 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3401c070 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340166b0 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c44162120 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.775+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c44161880 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.776+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c440752b0 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.777+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c34005d10 con 0x7f2c44154940 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.777+0000 7f2c3b7fe640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 0x7f2c2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:15.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.777+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c3408c4f0 con 0x7f2c44154940 2024-04-16T12:55:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.777+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 0x7f2c2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.778+0000 7f2c42ffd640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 0x7f2c2406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:15.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:15.781+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c34026020 con 0x7f2c44154940 2024-04-16T12:55:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.003+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c4406c9a0 con 0x7f2c44154940 2024-04-16T12:55:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.003+0000 7f2c3b7fe640 1 -- 172.21.15.18:0/416769276 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5189 (secure 0 0 0) 0x7f2c3405a5e0 con 0x7f2c44154940 2024-04-16T12:55:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:16.005 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:14.013121+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:16.005 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-16T12:55:16.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 msgr2=0x7f2c2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 0x7f2c2406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c030000 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 msgr2=0x7f2c44154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009ed0 tx=0x7f2c340115a0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 shutdown_connections 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2c2406c8f0 0x7f2c2406edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c44154940 0x7f2c44154dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c440ca910 0x7f2c44161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 --2- 172.21.15.18:0/416769276 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2c300039b0 0x7f2c4414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 >> 172.21.15.18:0/416769276 conn(0x7f2c440b69e0 msgr2=0x7f2c440b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 shutdown_connections 2024-04-16T12:55:16.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.005+0000 7f2c49524640 1 -- 172.21.15.18:0/416769276 wait complete. 2024-04-16T12:55:16.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:16.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.120+0000 7f1ae49bd640 1 Processor -- start 2024-04-16T12:55:16.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.120+0000 7f1ae49bd640 1 -- start start 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ae49bd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 0x7f1ae00d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ae49bd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ae00b3ea0 0x7f1ae00d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ae49bd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ae00cfe40 con 0x7f1ae015ef70 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ae49bd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae00d0120 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ae49bd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae00d2470 con 0x7f1ae006c130 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1aded9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ae00b3ea0 0x7f1ae00d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ade59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1ae015ef70 0x7f1ae006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38990/0 (socket says 172.21.15.18:38990) 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ade59c640 1 -- 172.21.15.18:0/2194765312 learned_addr learned my addr 172.21.15.18:0/2194765312 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ad5d9b640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 0x7f1ae00d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1aded9d640 1 -- 172.21.15.18:0/2194765312 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 msgr2=0x7f1ae00d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1aded9d640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 0x7f1ae00d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1aded9d640 1 -- 172.21.15.18:0/2194765312 >> v1:172.21.15.18:6789/0 conn(0x7f1ae015ef70 legacy=0x7f1ae006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1aded9d640 1 -- 172.21.15.18:0/2194765312 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae00d2750 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1addd9b640 1 -- 172.21.15.18:0/2194765312 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600091917 0 0) 0x7f1ae00cfe40 con 0x7f1ae015ef70 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.121+0000 7f1ad5d9b640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 0x7f1ae00d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1aded9d640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae00b3ea0 0x7f1ae00d31b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009d90 tx=0x7f1ad802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df88c81b9c13f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1addd9b640 1 -- 172.21.15.18:0/2194765312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8039070 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1addd9b640 1 -- 172.21.15.18:0/2194765312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad802cc50 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1addd9b640 1 -- 172.21.15.18:0/2194765312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8034440 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2194765312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae00b3ea0 msgr2=0x7f1ae00d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae00b3ea0 0x7f1ae00d31b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009d90 tx=0x7f1ad802bea0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2194765312 shutdown_connections 2024-04-16T12:55:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae00b3ea0 0x7f1ae00d31b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2194765312 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae006c130 0x7f1ae00d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.122+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2194765312 >> 172.21.15.18:0/2194765312 conn(0x7f1ae00b69e0 msgr2=0x7f1ae00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.123+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2194765312 shutdown_connections 2024-04-16T12:55:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.123+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2194765312 wait complete. 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.124+0000 7f1ae49bd640 1 Processor -- start 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.124+0000 7f1ae49bd640 1 -- start start 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae00b3ea0 0x7f1ae00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 0x7f1ae015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae00b3510 con 0x7f1ae006c130 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae00b3390 con 0x7f1ae01f45f0 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae00b3690 con 0x7f1ae00b3ea0 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43444/0 (socket says 172.21.15.18:43444) 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 -- 172.21.15.18:0/2491487775 learned_addr learned my addr 172.21.15.18:0/2491487775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ad5d9b640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae00b3ea0 0x7f1ae00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1aded9d640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 0x7f1ae015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 -- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae00b3ea0 msgr2=0x7f1ae00c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae00b3ea0 0x7f1ae00c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 -- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 msgr2=0x7f1ae015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 0x7f1ae015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 -- 172.21.15.18:0/2491487775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae01f4af0 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1aded9d640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 0x7f1ae015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ade59c640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c4d0 tx=0x7f1ad000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0018070 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad0007500 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0004a20 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.125+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae01f4dd0 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.126+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae01f5390 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.127+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae00752b0 con 0x7f1ae006c130 2024-04-16T12:55:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.127+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ad001b070 con 0x7f1ae006c130 2024-04-16T12:55:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.127+0000 7f1ad77fe640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 0x7f1ac006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.128+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1ad008b230 con 0x7f1ae006c130 2024-04-16T12:55:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.128+0000 7f1ad5d9b640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 0x7f1ac006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.128+0000 7f1ad5d9b640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 0x7f1ac006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ae015b7a0 tx=0x7f1ac8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.132+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ad0059280 con 0x7f1ae006c130 2024-04-16T12:55:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.320+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ae006c9a0 con 0x7f1ae006c130 2024-04-16T12:55:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.321+0000 7f1ad77fe640 1 -- 172.21.15.18:0/2491487775 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f1ad0058b80 con 0x7f1ae006c130 2024-04-16T12:55:16.323 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:16.323 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 msgr2=0x7f1ac006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 0x7f1ac006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ae015b7a0 tx=0x7f1ac8008040 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 msgr2=0x7f1ae0160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c4d0 tx=0x7f1ad000c990 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 shutdown_connections 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ac006c8f0 0x7f1ac006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ae01f45f0 0x7f1ae015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1ae00b3ea0 0x7f1ae00c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 --2- 172.21.15.18:0/2491487775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ae006c130 0x7f1ae0160c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 >> 172.21.15.18:0/2491487775 conn(0x7f1ae00b69e0 msgr2=0x7f1ae00b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 shutdown_connections 2024-04-16T12:55:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.323+0000 7f1ae49bd640 1 -- 172.21.15.18:0/2491487775 wait complete. 2024-04-16T12:55:16.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T12:55:08.969245+0000', 'modified': '2024-04-16T12:55:14.013121+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54158}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54158': {'gid': 54158, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/2445582295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6835', 'nonce': 2445582295}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 2445582295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 54158, 'qdb_cluster': [54158]} 2024-04-16T12:55:16.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T12:55:16.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-16T12:55:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.844+0000 7f2e85b32640 1 Processor -- start 2024-04-16T12:55:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 -- start start 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 0x7f2e800cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e800b3ec0 0x7f2e800d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8015f100 con 0x7f2e800d4340 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2e800cf740 con 0x7f2e800b3ec0 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e85b32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e800cf8e0 con 0x7f2e8015ed20 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e7effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e800b3ec0 0x7f2e800d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e7effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e800b3ec0 0x7f2e800d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43458/0 (socket says 172.21.15.18:43458) 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.845+0000 7f2e7effd640 1 -- 172.21.15.18:0/3232615599 learned_addr learned my addr 172.21.15.18:0/3232615599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 0x7f2e800cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7effd640 1 -- 172.21.15.18:0/3232615599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 msgr2=0x7f2e800cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7effd640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 0x7f2e800cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7effd640 1 -- 172.21.15.18:0/3232615599 >> v1:172.21.15.104:6789/0 conn(0x7f2e800d4340 legacy=0x7f2e800b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7effd640 1 -- 172.21.15.18:0/3232615599 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e800cfb30 con 0x7f2e800b3ec0 2024-04-16T12:55:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 0x7f2e800cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:16.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.846+0000 7f2e7effd640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800d3e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009870 tx=0x7f2e7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e9626742d2c724 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e7e7fc640 1 -- 172.21.15.18:0/3232615599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74035020 con 0x7f2e800b3ec0 2024-04-16T12:55:16.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e7e7fc640 1 -- 172.21.15.18:0/3232615599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74031640 con 0x7f2e800b3ec0 2024-04-16T12:55:16.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e7e7fc640 1 -- 172.21.15.18:0/3232615599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7402d040 con 0x7f2e800b3ec0 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 -- 172.21.15.18:0/3232615599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 msgr2=0x7f2e800d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800d3e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009870 tx=0x7f2e7402b8f0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 -- 172.21.15.18:0/3232615599 shutdown_connections 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800d3e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 --2- 172.21.15.18:0/3232615599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e8015ed20 0x7f2e800cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 -- 172.21.15.18:0/3232615599 >> 172.21.15.18:0/3232615599 conn(0x7f2e800d1390 msgr2=0x7f2e800d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 -- 172.21.15.18:0/3232615599 shutdown_connections 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.847+0000 7f2e85b32640 1 -- 172.21.15.18:0/3232615599 wait complete. 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.848+0000 7f2e85b32640 1 Processor -- start 2024-04-16T12:55:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.848+0000 7f2e85b32640 1 -- start start 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e800d4340 0x7f2e800cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 0x7f2e801610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800d38e0 con 0x7f2e800b3ec0 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800d3600 con 0x7f2e8015ed20 2024-04-16T12:55:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e85b32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e800d00f0 con 0x7f2e800d4340 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43474/0 (socket says 172.21.15.18:43474) 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2561226541 learned_addr learned my addr 172.21.15.18:0/2561226541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 0x7f2e801610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e800d4340 0x7f2e800cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.849+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e800d4340 msgr2=0x7f2e800cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e800d4340 0x7f2e800cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 msgr2=0x7f2e801610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 0x7f2e801610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2561226541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80160340 con 0x7f2e800b3ec0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 0x7f2e801610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cf90 tx=0x7f2e7000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e67fff640 1 -- 172.21.15.18:0/2561226541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7001a070 con 0x7f2e800b3ec0 2024-04-16T12:55:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e67fff640 1 -- 172.21.15.18:0/2561226541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7000d840 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e800ce7c0 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e67fff640 1 -- 172.21.15.18:0/2561226541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000dc10 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.850+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80160bc0 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.851+0000 7f2e67fff640 1 -- 172.21.15.18:0/2561226541 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e7001d070 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.852+0000 7f2e67fff640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 0x7f2e6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.852+0000 7f2e67fff640 1 -- 172.21.15.18:0/2561226541 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e7008c670 con 0x7f2e800b3ec0 2024-04-16T12:55:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.852+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 0x7f2e6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.852+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 0x7f2e6c06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e74036000 tx=0x7f2e74008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 Processor -- start 2024-04-16T12:55:16.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 -- start start 2024-04-16T12:55:16.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc666eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc663eb10 0x555cc666bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555cc65a89c0 con 0x555cc6642670 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555cc654f650 con 0x555cc663eb10 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.853+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x555cc65a4980 con 0x555cc666eaf0 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43488/0 (socket says 172.21.15.18:43488) 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 -- 172.21.15.18:0/4284392967 learned_addr learned my addr 172.21.15.18:0/4284392967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc666eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7effd640 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc663eb10 0x555cc666bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 -- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 msgr2=0x555cc666eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc666eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 -- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc663eb10 msgr2=0x555cc666bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc663eb10 0x555cc666bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 -- 172.21.15.18:0/4284392967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc62bb2d0 con 0x555cc6642670 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e78003e70 tx=0x7f2e78004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc00406f1921459 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e657fa640 1 -- 172.21.15.18:0/4284392967 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78005270 con 0x555cc6642670 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e657fa640 1 -- 172.21.15.18:0/4284392967 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e78005430 con 0x555cc6642670 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.854+0000 7f2e657fa640 1 -- 172.21.15.18:0/4284392967 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800db80 con 0x555cc6642670 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- 172.21.15.18:0/4284392967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 msgr2=0x555cc666c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e78003e70 tx=0x7f2e78004330 comp rx=0 tx=0).stop 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- 172.21.15.18:0/4284392967 shutdown_connections 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc666c2a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc663eb10 0x555cc666bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 --2- 172.21.15.18:0/4284392967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc666eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- 172.21.15.18:0/4284392967 >> 172.21.15.18:0/4284392967 conn(0x555cc6640d80 msgr2=0x555cc6689900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- 172.21.15.18:0/4284392967 shutdown_connections 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- 172.21.15.18:0/4284392967 wait complete. 2024-04-16T12:55:16.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 -- start start 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.855+0000 7f2e887fc740 1 Processor -- start 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6642670 0x555cc6664110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc66650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555cc6643820 con 0x555cc666eaf0 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555cc6562a10 con 0x555cc6669430 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x555cc6642c10 con 0x555cc6642670 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e887fc740 10 client.0 _ll_register_callbacks cb 0x555cc6562400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43490/0 (socket says 172.21.15.18:43490) 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e7effd640 1 -- 172.21.15.18:0/467610429 learned_addr learned my addr 172.21.15.18:0/467610429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc66650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.856+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6642670 0x555cc6664110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 -- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6642670 msgr2=0x555cc6664110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6642670 0x555cc6664110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 -- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 msgr2=0x555cc66650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc66650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 -- 172.21.15.18:0/467610429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc63856b0 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc66650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e7effd640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e7402bf00 tx=0x7f2e7402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8494d3967ded60 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74054060 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e7404f480 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e78005430 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2e74035040 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 10 client.4440 fetch_fsmap learned FSMap version 7 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555cc6668c30 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e78005430 con 0x555cc666eaf0 2024-04-16T12:55:16.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f2e7404f680 con 0x555cc666eaf0 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 10 client.4440 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 20 client.4440 populate_metadata read hostname 'smithi018' 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc669db50 0x555cc669df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 4 client.4440 mds_command: new command op to 54158 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.857+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 --> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc65b63e0 con 0x555cc669db50 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.858+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc669db50 0x555cc669df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.858+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc669db50 0x555cc669df30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2baae8dd14c35a2 server_cookie=64a4aac45afd5822 in_seq=0 out_seq=0 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.858+0000 7f2e5e7fc640 10 client.4440 ms_handle_connect on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/467610429 <== mds.0 v2:172.21.15.104:6835/2445582295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555cc65b63e0 con 0x555cc669db50 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e5e7fc640 10 client.4440 handle_command_reply: tid=0 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 client.4440 shutdown 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 msgr2=0x555cc6670490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e7402bf00 tx=0x7f2e7402e000 comp rx=0 tx=0).stop 2024-04-16T12:55:16.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 shutdown_connections 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc669db50 0x555cc669df30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc66650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6670490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e5e7fc640 0 client.4440 ms_handle_reset on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 --2- 172.21.15.18:0/467610429 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6642670 0x555cc6664110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 >> 172.21.15.18:0/467610429 conn(0x555cc663eb10 msgr2=0x555cc6672670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 shutdown_connections 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 1 -- 172.21.15.18:0/467610429 wait complete. 2024-04-16T12:55:16.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.859+0000 7f2e887fc740 20 client.4440 trim_cache size 0 max 16384 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.877+0000 7f2e887fc740 1 Processor -- start 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.877+0000 7f2e887fc740 1 -- start start 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6642670 0x555cc666ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6669430 0x555cc6663510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80201420 con 0x555cc666eaf0 2024-04-16T12:55:16.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80200780 con 0x555cc6642670 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e80200dd0 con 0x555cc6669430 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43502/0 (socket says 172.21.15.18:43502) 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.878+0000 7f2e7ffff640 1 -- 172.21.15.18:0/2337055135 learned_addr learned my addr 172.21.15.18:0/2337055135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6642670 0x555cc666ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6669430 0x555cc6663510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 -- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6669430 msgr2=0x555cc6663510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6669430 0x555cc6663510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 -- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6642670 msgr2=0x555cc666ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6642670 0x555cc666ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 -- 172.21.15.18:0/2337055135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc668d9e0 con 0x555cc666eaf0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007fd0 tx=0x7f2e78012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccfaa25d81a6941 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e64ff9640 1 -- 172.21.15.18:0/2337055135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78005240 con 0x555cc666eaf0 2024-04-16T12:55:16.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e64ff9640 1 -- 172.21.15.18:0/2337055135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e78005400 con 0x555cc666eaf0 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.879+0000 7f2e64ff9640 1 -- 172.21.15.18:0/2337055135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800db80 con 0x555cc666eaf0 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- 172.21.15.18:0/2337055135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 msgr2=0x555cc6664900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007fd0 tx=0x7f2e78012000 comp rx=0 tx=0).stop 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- 172.21.15.18:0/2337055135 shutdown_connections 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc666eaf0 0x555cc6664900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc6669430 0x555cc6663510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2337055135 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6642670 0x555cc666ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- 172.21.15.18:0/2337055135 >> 172.21.15.18:0/2337055135 conn(0x555cc663eb10 msgr2=0x555cc663a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- 172.21.15.18:0/2337055135 shutdown_connections 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- 172.21.15.18:0/2337055135 wait complete. 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 -- start start 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.880+0000 7f2e887fc740 1 Processor -- start 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc668d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc6659ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555cc6669950 con 0x555cc6642670 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555cc6668fd0 con 0x555cc6669430 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x555cc66672d0 con 0x555cc666eaf0 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e887fc740 10 client.0 _ll_register_callbacks cb 0x7f2e74031760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43510/0 (socket says 172.21.15.18:43510) 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2056373072 learned_addr learned my addr 172.21.15.18:0/2056373072 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 msgr2=0x555cc6659ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc668d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7ffff640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc6659ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc6659ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 msgr2=0x555cc668d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc668d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.881+0000 7f2e7f7fe640 1 -- 172.21.15.18:0/2056373072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc6705580 con 0x555cc6642670 2024-04-16T12:55:16.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e7f7fe640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cf60 tx=0x7f2e7008c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62936737ec6ee9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70056780 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e700627b0 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e78005400 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f2e70056920 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 10 client.4446 fetch_fsmap learned FSMap version 7 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555cc665cdb0 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e78005400 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f2e70059560 con 0x555cc6642670 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 20 client.4446 populate_metadata read hostname 'smithi018' 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc66acc40 0x555cc66ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 4 client.4446 mds_command: new command op to 54158 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T12:55:16.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 --> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] -- command(tid 0: {"prefix": "status"}) -- 0x555cc663f310 con 0x555cc66acc40 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.882+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc66acc40 0x555cc66ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e5e7fc640 10 client.4446 ms_handle_connect on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e7effd640 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc66acc40 0x555cc66ad020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb37d3144f50180 server_cookie=2438babb7ff660c in_seq=0 out_seq=0 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e5e7fc640 1 -- 172.21.15.18:0/2056373072 <== mds.0 v2:172.21.15.104:6835/2445582295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555cc663f310 con 0x555cc66acc40 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e5e7fc640 10 client.4446 handle_command_reply: tid=0 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 client.4446 shutdown 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 msgr2=0x555cc668ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cf60 tx=0x7f2e7008c040 comp rx=0 tx=0).stop 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 shutdown_connections 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x555cc666eaf0 0x555cc6659ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x555cc66acc40 0x555cc66ad020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555cc6669430 0x555cc668d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e5e7fc640 0 client.4446 ms_handle_reset on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 --2- 172.21.15.18:0/2056373072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555cc6642670 0x555cc668ce10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 >> 172.21.15.18:0/2056373072 conn(0x555cc663eb10 msgr2=0x555cc663d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 shutdown_connections 2024-04-16T12:55:16.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 1 -- 172.21.15.18:0/2056373072 wait complete. 2024-04-16T12:55:16.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.883+0000 7f2e887fc740 20 client.4446 trim_cache size 0 max 16384 2024-04-16T12:55:16.894 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:55:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "4f03925b-4efb-4ceb-afe9-e5d42c409d27", 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 54158, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 7.2959630070000001, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 7, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 24, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 24, 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 14.771659458 2024-04-16T12:55:16.895 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 msgr2=0x7f2e6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 0x7f2e6c06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e74036000 tx=0x7f2e74008030 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 msgr2=0x7f2e800c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000cf90 tx=0x7f2e7000a7d0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 shutdown_connections 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e6c06c8f0 0x7f2e6c06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8015ed20 0x7f2e801610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e800d4340 0x7f2e800cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 --2- 172.21.15.18:0/2561226541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e800b3ec0 0x7f2e800c85f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 >> 172.21.15.18:0/2561226541 conn(0x7f2e800d1390 msgr2=0x7f2e800b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 shutdown_connections 2024-04-16T12:55:16.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:16.884+0000 7f2e85b32640 1 -- 172.21.15.18:0/2561226541 wait complete. 2024-04-16T12:55:16.898 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:55:16.898 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:16.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:55:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.000+0000 7f2d3c6b8640 1 Processor -- start 2024-04-16T12:55:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.000+0000 7f2d3c6b8640 1 -- start start 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.001+0000 7f2d3c6b8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.001+0000 7f2d3c6b8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.001+0000 7f2d3c6b8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340b2640 con 0x7f2d3415bc20 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.001+0000 7f2d3c6b8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2d340b3da0 con 0x7f2d3406e2c0 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.001+0000 7f2d3c6b8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2d340b28c0 con 0x7f2d3415b840 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3ac55640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:55926/0 (socket says 172.21.15.18:55926) 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3ac55640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:51922/0 (socket says 172.21.15.18:51922) 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 -- 172.21.15.18:0/1083795772 learned_addr learned my addr 172.21.15.18:0/1083795772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d39452640 1 -- 172.21.15.18:0/1083795772 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165373300 0 0) 0x7f2d28001110 con 0x7f2d3415bc20 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d39452640 1 -- 172.21.15.18:0/1083795772 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d1c003520 con 0x7f2d3415bc20 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 -- 172.21.15.18:0/1083795772 >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 msgr2=0x7f2d340b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 --2- 172.21.15.18:0/1083795772 >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 -- 172.21.15.18:0/1083795772 >> v1:172.21.15.104:6789/0 conn(0x7f2d3415bc20 legacy=0x7f2d3406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3a454640 1 -- 172.21.15.18:0/1083795772 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340b2ba0 con 0x7f2d3415b840 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.002+0000 7f2d3ac55640 1 --2- 172.21.15.18:0/1083795772 >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d3a454640 1 --2- 172.21.15.18:0/1083795772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009870 tx=0x7f2d2c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7fc9665affd1986 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d39452640 1 -- 172.21.15.18:0/1083795772 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c034070 con 0x7f2d3415b840 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d39452640 1 -- 172.21.15.18:0/1083795772 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c030840 con 0x7f2d3415b840 2024-04-16T12:55:17.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d39452640 1 -- 172.21.15.18:0/1083795772 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c030bf0 con 0x7f2d3415b840 2024-04-16T12:55:17.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1083795772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 msgr2=0x7f2d340cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.003+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1083795772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009870 tx=0x7f2d2c02b980 comp rx=0 tx=0).stop 2024-04-16T12:55:17.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1083795772 shutdown_connections 2024-04-16T12:55:17.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1083795772 >> v2:172.21.15.104:3300/0 conn(0x7f2d3406e2c0 0x7f2d340b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1083795772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d3415b840 0x7f2d340cf190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1083795772 >> 172.21.15.18:0/1083795772 conn(0x7f2d3409aa10 msgr2=0x7f2d340b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1083795772 shutdown_connections 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.004+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1083795772 wait complete. 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.005+0000 7f2d3c6b8640 1 Processor -- start 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.005+0000 7f2d3c6b8640 1 -- start start 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.005+0000 7f2d3c6b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d3406e2c0 0x7f2d341f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.005+0000 7f2d3c6b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 0x7f2d3406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d340b39a0 con 0x7f2d3415b840 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2d340b3820 con 0x7f2d3406e2c0 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2d340b3b20 con 0x7f2d340c6c00 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43524/0 (socket says 172.21.15.18:43524) 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 -- 172.21.15.18:0/1969672567 learned_addr learned my addr 172.21.15.18:0/1969672567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3a454640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d3406e2c0 0x7f2d341f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3ac55640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 0x7f2d3406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 -- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 msgr2=0x7f2d3406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 0x7f2d3406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 -- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d3406e2c0 msgr2=0x7f2d341f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d3406e2c0 0x7f2d341f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 -- 172.21.15.18:0/1969672567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341f2a60 con 0x7f2d3415b840 2024-04-16T12:55:17.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3ac55640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 0x7f2d3406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d39c53640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c700 tx=0x7f2d2800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d280052d0 con 0x7f2d3415b840 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28005490 con 0x7f2d3415b840 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d341f2d40 con 0x7f2d3415b840 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28003830 con 0x7f2d3415b840 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.006+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d341f3020 con 0x7f2d3415b840 2024-04-16T12:55:17.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.007+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d34068a70 con 0x7f2d3415b840 2024-04-16T12:55:17.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.008+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d280039d0 con 0x7f2d3415b840 2024-04-16T12:55:17.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.008+0000 7f2d32ffd640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:17.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.008+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2d2808b990 con 0x7f2d3415b840 2024-04-16T12:55:17.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.008+0000 7f2d3a454640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:17.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.009+0000 7f2d3a454640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 0x7f2d2006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:17.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.013+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d340b2640 con 0x7f2d3415b840 2024-04-16T12:55:17.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.236+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2d340d2490 con 0x7f2d3415b840 2024-04-16T12:55:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.236+0000 7f2d32ffd640 1 -- 172.21.15.18:0/1969672567 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f2d280102e0 con 0x7f2d3415b840 2024-04-16T12:55:17.238 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 msgr2=0x7f2d2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 0x7f2d2006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c03b040 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 msgr2=0x7f2d34155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c700 tx=0x7f2d2800cbc0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 shutdown_connections 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d340c6c00 0x7f2d3406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d3415b840 0x7f2d34155970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 --2- 172.21.15.18:0/1969672567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d3406e2c0 0x7f2d341f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 >> 172.21.15.18:0/1969672567 conn(0x7f2d3409aa10 msgr2=0x7f2d340cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 shutdown_connections 2024-04-16T12:55:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17.238+0000 7f2d3c6b8640 1 -- 172.21.15.18:0/1969672567 wait complete. 2024-04-16T12:55:17.250 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T12:55:17.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:55:17.251 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T12:55:17.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:17.251 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:17.267 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42729sec preferred_lft 42729sec 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link noprefixroute 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:17.268 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-16T12:55:17.269 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T12:55:17.269 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:17.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:17.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:17.500 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:55:17.529 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-16T12:55:17.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:17.530 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-16T12:55:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-16T12:55:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:55:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T12:55:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T12:55:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T12:55:17.604 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:17.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:17.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:17.918 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:55:17.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:17.935 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-16T12:55:17.993 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:17.993 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:17.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:17.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-16T12:55:17.994 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:18.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:18.123 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-16T12:55:18.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-16T12:55:18.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-16T12:55:18.124 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:18.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:18.266 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:18.266 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:18.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-16T12:55:18.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T12:55:18.267 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:18.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:18.355 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-16T12:55:18.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:18.355 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:18.371 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T12:55:18.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:18.371 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:18.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-16T12:55:18.495 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T12:55:18.552 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-16T12:55:18.552 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-16T12:55:18.552 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-16T12:55:18.552 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-16T12:55:18.552 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T12:55:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T12:55:18.554 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-16T12:55:18.555 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:18.556 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:18.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:18.556 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-16T12:55:18.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T12:55:18.608 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-16T12:55:18.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-16T12:55:18.679 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-16T12:55:18.737 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/selinux 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T12:55:18.738 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:18.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:18.739 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-16T12:55:18.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-04-16T12:55:18.742+0000 7fcff7dd5480 -1 init, newargv = 0x560f22ef2bc0 newargc=15 2024-04-16T12:55:18.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[44195]: starting ceph client 2024-04-16T12:55:18.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[44195]: starting fuse 2024-04-16T12:55:18.760 INFO:teuthology.orchestra.run.smithi018.stdout:41 2024-04-16T12:55:18.760 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T12:55:18.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-04-16T12:55:18.760 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-04-16T12:55:18.760 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-16T12:55:18.761 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-04-16T12:55:18.762 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-16T12:55:18.884 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.44195.asok 2024-04-16T12:55:18.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:18.895 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44195.asok 2024-04-16T12:55:18.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:18.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44195.asok status 2024-04-16T12:55:19.034 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:55:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "44195", 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4455, 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-04-16T12:55:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4455 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 486465203 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 486465203 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4455 192.168.0.1:0/486465203", 2024-04-16T12:55:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/486465203", 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 7, 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 24, 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-04-16T12:55:19.037 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:55:19.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:19.043 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-04-16T12:55:19.043 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:19.059 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-04-16T12:55:19.060 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:19.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:19.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:19.129 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-16T12:55:19.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:19.236 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-04-16T12:55:19.237 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-16T12:55:19.237 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:19.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:19.242 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:19.243 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:19.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.401+0000 7f033fc88640 1 Processor -- start 2024-04-16T12:55:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 -- start start 2024-04-16T12:55:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f03381603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03380ccd80 0x7f03380b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f03380b46f0 0x7f033806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f033815cc00 con 0x7f03380ccd80 2024-04-16T12:55:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0338160a30 con 0x7f03380b46f0 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033fc88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0338160d10 con 0x7f033815c820 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.402+0000 7f033d223640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03380ccd80 0x7f03380b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03380ccd80 0x7f03380b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43540/0 (socket says 172.21.15.18:43540) 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 -- 172.21.15.18:0/3311954938 learned_addr learned my addr 172.21.15.18:0/3311954938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033e225640 1 --2- 172.21.15.18:0/3311954938 >> v2:172.21.15.104:3300/0 conn(0x7f03380b46f0 0x7f033806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033da24640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f03381603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 -- 172.21.15.18:0/3311954938 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 msgr2=0x7f03381603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f03381603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 -- 172.21.15.18:0/3311954938 >> v2:172.21.15.104:3300/0 conn(0x7f03380b46f0 msgr2=0x7f033806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 --2- 172.21.15.18:0/3311954938 >> v2:172.21.15.104:3300/0 conn(0x7f03380b46f0 0x7f033806ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.403+0000 7f033d223640 1 -- 172.21.15.18:0/3311954938 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338160ff0 con 0x7f03380ccd80 2024-04-16T12:55:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033d223640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f03380b41b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f03380c6200 tx=0x7f032802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefa3bb640e77def server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033ca22640 1 -- 172.21.15.18:0/3311954938 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328038070 con 0x7f03380ccd80 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033ca22640 1 -- 172.21.15.18:0/3311954938 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032802f050 con 0x7f03380ccd80 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033ca22640 1 -- 172.21.15.18:0/3311954938 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328031970 con 0x7f03380ccd80 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 -- 172.21.15.18:0/3311954938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 msgr2=0x7f03380b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f03380b41b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f03380c6200 tx=0x7f032802b7f0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 -- 172.21.15.18:0/3311954938 shutdown_connections 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 --2- 172.21.15.18:0/3311954938 >> v2:172.21.15.104:3300/0 conn(0x7f03380b46f0 0x7f033806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f03380b41b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 --2- 172.21.15.18:0/3311954938 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f03381603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 -- 172.21.15.18:0/3311954938 >> 172.21.15.18:0/3311954938 conn(0x7f03380cf1b0 msgr2=0x7f03380cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 -- 172.21.15.18:0/3311954938 shutdown_connections 2024-04-16T12:55:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.404+0000 7f033fc88640 1 -- 172.21.15.18:0/3311954938 wait complete. 2024-04-16T12:55:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 Processor -- start 2024-04-16T12:55:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 -- start start 2024-04-16T12:55:19.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03380b46f0 0x7f033814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f033815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f033806f280 con 0x7f03380ccd80 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b8260 con 0x7f03380b46f0 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033fc88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f033806f400 con 0x7f033815c820 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033d223640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033d223640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43544/0 (socket says 172.21.15.18:43544) 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.406+0000 7f033d223640 1 -- 172.21.15.18:0/3626759439 learned_addr learned my addr 172.21.15.18:0/3626759439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033e225640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f033815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033da24640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03380b46f0 0x7f033814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 -- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 msgr2=0x7f033815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f033815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 -- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03380b46f0 msgr2=0x7f033814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03380b46f0 0x7f033814e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 -- 172.21.15.18:0/3626759439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338151660 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033d223640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f032802b830 tx=0x7f03280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328042070 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032803d890 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328038040 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033815d960 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.407+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033815df20 con 0x7f03380ccd80 2024-04-16T12:55:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.408+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0338068a70 con 0x7f03380ccd80 2024-04-16T12:55:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.409+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0328045070 con 0x7f03380ccd80 2024-04-16T12:55:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.409+0000 7f032e7fc640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 0x7f031c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.409+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f03280adc60 con 0x7f03380ccd80 2024-04-16T12:55:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.410+0000 7f033da24640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 0x7f031c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.410+0000 7f033da24640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 0x7f031c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03340079a0 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.414+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f032807b6f0 con 0x7f03380ccd80 2024-04-16T12:55:19.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.602+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03380cf840 con 0x7f03380ccd80 2024-04-16T12:55:19.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.603+0000 7f032e7fc640 1 -- 172.21.15.18:0/3626759439 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f032807f9f0 con 0x7f03380ccd80 2024-04-16T12:55:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:19.605 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 msgr2=0x7f031c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 0x7f031c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03340079a0 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 msgr2=0x7f033815f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f032802b830 tx=0x7f03280046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 shutdown_connections 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f031c06c8f0 0x7f031c06edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f033815c820 0x7f033815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03380ccd80 0x7f033815f1c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 --2- 172.21.15.18:0/3626759439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03380b46f0 0x7f033814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 >> 172.21.15.18:0/3626759439 conn(0x7f03380cf1b0 msgr2=0x7f0338158420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 shutdown_connections 2024-04-16T12:55:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.605+0000 7f033fc88640 1 -- 172.21.15.18:0/3626759439 wait complete. 2024-04-16T12:55:19.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:19.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.725+0000 7f38d4688640 1 Processor -- start 2024-04-16T12:55:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.725+0000 7f38d4688640 1 -- start start 2024-04-16T12:55:19.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d4688640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0d3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d4688640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38cc15f0b0 0x7f38cc06be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d4688640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38cc06c340 con 0x7f38cc0b34b0 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d4688640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f38cc0d2ea0 con 0x7f38cc15f0b0 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d4688640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f38cc0d30f0 con 0x7f38cc06ba20 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1c23640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38cc15f0b0 0x7f38cc06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d2c25640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f38cc0b34b0 0x7f38cc0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38994/0 (socket says 172.21.15.18:38994) 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d2c25640 1 -- 172.21.15.18:0/2270932272 learned_addr learned my addr 172.21.15.18:0/2270932272 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d2424640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0d3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1c23640 1 -- 172.21.15.18:0/2270932272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 msgr2=0x7f38cc0d3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1c23640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0d3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1422640 1 -- 172.21.15.18:0/2270932272 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533258912 0 0) 0x7f38cc06c340 con 0x7f38cc0b34b0 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1c23640 1 -- 172.21.15.18:0/2270932272 >> v1:172.21.15.18:6789/0 conn(0x7f38cc0b34b0 legacy=0x7f38cc0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.726+0000 7f38d1c23640 1 -- 172.21.15.18:0/2270932272 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc0d33d0 con 0x7f38cc15f0b0 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.727+0000 7f38d1c23640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc15f0b0 0x7f38cc06be00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0097a0 tx=0x7f38bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a046a34ff9ff9512 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.727+0000 7f38d1422640 1 -- 172.21.15.18:0/2270932272 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0315a0 con 0x7f38cc15f0b0 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.727+0000 7f38d1422640 1 -- 172.21.15.18:0/2270932272 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc037070 con 0x7f38cc15f0b0 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.727+0000 7f38d1422640 1 -- 172.21.15.18:0/2270932272 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc031960 con 0x7f38cc15f0b0 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 -- 172.21.15.18:0/2270932272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc15f0b0 msgr2=0x7f38cc06be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc15f0b0 0x7f38cc06be00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0097a0 tx=0x7f38bc02b840 comp rx=0 tx=0).stop 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 -- 172.21.15.18:0/2270932272 shutdown_connections 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc15f0b0 0x7f38cc06be00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 --2- 172.21.15.18:0/2270932272 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0d3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 -- 172.21.15.18:0/2270932272 >> 172.21.15.18:0/2270932272 conn(0x7f38cc0b67f0 msgr2=0x7f38cc0b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 -- 172.21.15.18:0/2270932272 shutdown_connections 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.728+0000 7f38d4688640 1 -- 172.21.15.18:0/2270932272 wait complete. 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.729+0000 7f38d4688640 1 Processor -- start 2024-04-16T12:55:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.729+0000 7f38d4688640 1 -- start start 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 0x7f38cc158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0b3f50 con 0x7f38cc0b34b0 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0d3990 con 0x7f38cc15f0b0 2024-04-16T12:55:19.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f38cc0b40d0 con 0x7f38cc06ba20 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43558/0 (socket says 172.21.15.18:43558) 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 -- 172.21.15.18:0/1958660336 learned_addr learned my addr 172.21.15.18:0/1958660336 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d2424640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d2c25640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 0x7f38cc158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 -- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 msgr2=0x7f38cc0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 -- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 msgr2=0x7f38cc158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 0x7f38cc158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 -- 172.21.15.18:0/1958660336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc15fd60 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d2424640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d2c25640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 0x7f38cc158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d1c23640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f38bc034040 tx=0x7f38bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc032630 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc0327d0 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc160040 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc032bc0 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.730+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc160600 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.731+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38cc0752b0 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.732+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38bc03b3f0 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.732+0000 7f38c2ffd640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 0x7f38b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.732+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f38bc02f030 con 0x7f38cc0b34b0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.733+0000 7f38d2424640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 0x7f38b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:19.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.733+0000 7f38d2424640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 0x7f38b006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009af0 tx=0x7f38c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.737+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38bc040070 con 0x7f38cc0b34b0 2024-04-16T12:55:19.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.921+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38cc0b5e70 con 0x7f38cc0b34b0 2024-04-16T12:55:19.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.921+0000 7f38c2ffd640 1 -- 172.21.15.18:0/1958660336 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f38bc07bfb0 con 0x7f38cc0b34b0 2024-04-16T12:55:19.923 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 msgr2=0x7f38b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 0x7f38b006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009af0 tx=0x7f38c8008040 comp rx=0 tx=0).stop 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 msgr2=0x7f38cc158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f38bc034040 tx=0x7f38bc0046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 shutdown_connections 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b006c920 0x7f38b006ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38cc15f0b0 0x7f38cc158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38cc0b34b0 0x7f38cc158120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 --2- 172.21.15.18:0/1958660336 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38cc06ba20 0x7f38cc0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:19.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 >> 172.21.15.18:0/1958660336 conn(0x7f38cc0b67f0 msgr2=0x7f38cc06be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:19.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 shutdown_connections 2024-04-16T12:55:19.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:19.923+0000 7f38d4688640 1 -- 172.21.15.18:0/1958660336 wait complete. 2024-04-16T12:55:19.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:20.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 Processor -- start 2024-04-16T12:55:20.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 -- start start 2024-04-16T12:55:20.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff5d0156cb0 0x7ff5d00af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d00af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d006e6e0 con 0x7ff5d00d09a0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d006e950 con 0x7ff5d0156cb0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.043+0000 7ff5d6fca640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d006ec30 con 0x7ff5d015d720 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d5567640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5d00d09a0 0x7ff5d00ade30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38998/0 (socket says 172.21.15.18:38998) 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d5567640 1 -- 172.21.15.18:0/552420339 learned_addr learned my addr 172.21.15.18:0/552420339 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/552420339 >> v2:172.21.15.104:3300/0 conn(0x7ff5d0156cb0 0x7ff5d00af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5cffff640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d00af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5cf7fe640 1 -- 172.21.15.18:0/552420339 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677043937 0 0) 0x7ff5d006e6e0 con 0x7ff5d00d09a0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5cf7fe640 1 -- 172.21.15.18:0/552420339 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5c0003520 con 0x7ff5d00d09a0 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d4d66640 1 -- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 msgr2=0x7ff5d00af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d00af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d4d66640 1 -- 172.21.15.18:0/552420339 >> v1:172.21.15.18:6789/0 conn(0x7ff5d00d09a0 legacy=0x7ff5d00ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.044+0000 7ff5d4d66640 1 -- 172.21.15.18:0/552420339 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d006ef10 con 0x7ff5d0156cb0 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.045+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d0156cb0 0x7ff5d00af0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40097a0 tx=0x7ff5c402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba166b9cc38f3e74 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.045+0000 7ff5cf7fe640 1 -- 172.21.15.18:0/552420339 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4035020 con 0x7ff5d0156cb0 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.045+0000 7ff5cf7fe640 1 -- 172.21.15.18:0/552420339 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4031830 con 0x7ff5d0156cb0 2024-04-16T12:55:20.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.045+0000 7ff5cf7fe640 1 -- 172.21.15.18:0/552420339 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4031c00 con 0x7ff5d0156cb0 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 -- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d0156cb0 msgr2=0x7ff5d00af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d0156cb0 0x7ff5d00af0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40097a0 tx=0x7ff5c402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 -- 172.21.15.18:0/552420339 shutdown_connections 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d00af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/552420339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d0156cb0 0x7ff5d00af0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 -- 172.21.15.18:0/552420339 >> 172.21.15.18:0/552420339 conn(0x7ff5d00735b0 msgr2=0x7ff5d006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 -- 172.21.15.18:0/552420339 shutdown_connections 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.046+0000 7ff5d6fca640 1 -- 172.21.15.18:0/552420339 wait complete. 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.047+0000 7ff5d6fca640 1 Processor -- start 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.047+0000 7ff5d6fca640 1 -- start start 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d00d09a0 0x7ff5d00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d009cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0157210 con 0x7ff5d0156cb0 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0157090 con 0x7ff5d00d09a0 2024-04-16T12:55:20.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d0070440 con 0x7ff5d015d720 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43568/0 (socket says 172.21.15.18:43568) 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 -- 172.21.15.18:0/3085368318 learned_addr learned my addr 172.21.15.18:0/3085368318 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d00d09a0 0x7ff5d00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d5567640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d009cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 -- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 msgr2=0x7ff5d009cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d009cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 -- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d00d09a0 msgr2=0x7ff5d00b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d00d09a0 0x7ff5d00b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 -- 172.21.15.18:0/3085368318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d00b51a0 con 0x7ff5d0156cb0 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d5567640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cffff640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00e9b0 tx=0x7ff5bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc017070 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00c9a0 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d00b5480 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00cd90 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.048+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d00b5a40 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.049+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d00b5e80 con 0x7ff5d0156cb0 2024-04-16T12:55:20.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.050+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5bc01a070 con 0x7ff5d0156cb0 2024-04-16T12:55:20.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.050+0000 7ff5cd7fa640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.051+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff5bc08bd60 con 0x7ff5d0156cb0 2024-04-16T12:55:20.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.051+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.051+0000 7ff5d4d66640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 0x7ff5b406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4036000 tx=0x7ff5c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.055+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5bc059890 con 0x7ff5d0156cb0 2024-04-16T12:55:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.237+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff5d0068a70 con 0x7ff5d0156cb0 2024-04-16T12:55:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.237+0000 7ff5cd7fa640 1 -- 172.21.15.18:0/3085368318 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ff5bc05db90 con 0x7ff5d0156cb0 2024-04-16T12:55:20.240 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 msgr2=0x7ff5b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 0x7ff5b406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4036000 tx=0x7ff5c4008030 comp rx=0 tx=0).stop 2024-04-16T12:55:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 msgr2=0x7ff5d009be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00e9b0 tx=0x7ff5bc00ee70 comp rx=0 tx=0).stop 2024-04-16T12:55:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 shutdown_connections 2024-04-16T12:55:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff5b406c8f0 0x7ff5b406edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff5d015d720 0x7ff5d009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d0156cb0 0x7ff5d009be90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 --2- 172.21.15.18:0/3085368318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5d00d09a0 0x7ff5d00b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 >> 172.21.15.18:0/3085368318 conn(0x7ff5d00735b0 msgr2=0x7ff5d00b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 shutdown_connections 2024-04-16T12:55:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.239+0000 7ff5d6fca640 1 -- 172.21.15.18:0/3085368318 wait complete. 2024-04-16T12:55:20.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.357+0000 7f22bbf8f640 1 Processor -- start 2024-04-16T12:55:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 -- start start 2024-04-16T12:55:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b406dee0 0x7f22b40ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22b406e2c0 0x7f22b40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22b40cd8a0 0x7f22b4070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f22b40d0b00 con 0x7f22b40cd8a0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f22b40b0b20 con 0x7f22b406e2c0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22bbf8f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f22b40b0e00 con 0x7f22b406dee0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22ba52c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22b40cd8a0 0x7f22b4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.358+0000 7f22ba52c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22b40cd8a0 0x7f22b4070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43572/0 (socket says 172.21.15.18:43572) 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 -- 172.21.15.18:0/1857170781 learned_addr learned my addr 172.21.15.18:0/1857170781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22b952a640 1 --2- 172.21.15.18:0/1857170781 >> v2:172.21.15.104:3300/0 conn(0x7f22b406e2c0 0x7f22b40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22b9d2b640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b406dee0 0x7f22b40ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 -- 172.21.15.18:0/1857170781 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b406dee0 msgr2=0x7f22b40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b406dee0 0x7f22b40ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 -- 172.21.15.18:0/1857170781 >> v2:172.21.15.104:3300/0 conn(0x7f22b406e2c0 msgr2=0x7f22b40d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 --2- 172.21.15.18:0/1857170781 >> v2:172.21.15.104:3300/0 conn(0x7f22b406e2c0 0x7f22b40d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 -- 172.21.15.18:0/1857170781 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b40d0790 con 0x7f22b40cd8a0 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.359+0000 7f22ba52c640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b40cd8a0 0x7f22b4070310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f22b40729b0 tx=0x7f22a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c67c1032dcb5a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22b8d29640 1 -- 172.21.15.18:0/1857170781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a402ca70 con 0x7f22b40cd8a0 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22b8d29640 1 -- 172.21.15.18:0/1857170781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a402cc10 con 0x7f22b40cd8a0 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22b8d29640 1 -- 172.21.15.18:0/1857170781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a40343f0 con 0x7f22b40cd8a0 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1857170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b40cd8a0 msgr2=0x7f22b4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b40cd8a0 0x7f22b4070310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f22b40729b0 tx=0x7f22a402bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1857170781 shutdown_connections 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1857170781 >> v2:172.21.15.104:3300/0 conn(0x7f22b406e2c0 0x7f22b40d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b40cd8a0 0x7f22b4070310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1857170781 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b406dee0 0x7f22b40ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1857170781 >> 172.21.15.18:0/1857170781 conn(0x7f22b409aa10 msgr2=0x7f22b40b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1857170781 shutdown_connections 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.360+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1857170781 wait complete. 2024-04-16T12:55:20.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.361+0000 7f22bbf8f640 1 Processor -- start 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 -- start start 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 0x7f22b40b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 0x7f22b4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40d0530 con 0x7f22b406e2c0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40d03b0 con 0x7f22b406dee0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22bbf8f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f22b4070850 con 0x7f22b40cd8a0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22b952a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22b952a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43574/0 (socket says 172.21.15.18:43574) 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.362+0000 7f22b952a640 1 -- 172.21.15.18:0/1702209942 learned_addr learned my addr 172.21.15.18:0/1702209942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22ba52c640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 0x7f22b4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b9d2b640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 0x7f22b40b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 -- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 msgr2=0x7f22b4152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 0x7f22b4152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 -- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 msgr2=0x7f22b40b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 0x7f22b40b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 -- 172.21.15.18:0/1702209942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b40c97b0 con 0x7f22b406e2c0 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b9d2b640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 0x7f22b40b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22ba52c640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 0x7f22b4152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b952a640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22a800d800 tx=0x7f22a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a800b6c0 con 0x7f22b406e2c0 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a8019070 con 0x7f22b406e2c0 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b40c9a90 con 0x7f22b406e2c0 2024-04-16T12:55:20.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a800ba80 con 0x7f22b406e2c0 2024-04-16T12:55:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.363+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b40ca050 con 0x7f22b406e2c0 2024-04-16T12:55:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.364+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b40ca540 con 0x7f22b406e2c0 2024-04-16T12:55:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.364+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22a800bc20 con 0x7f22b406e2c0 2024-04-16T12:55:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.365+0000 7f22b27fc640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 0x7f22a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.365+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f22a808c3b0 con 0x7f22b406e2c0 2024-04-16T12:55:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.365+0000 7f22b9d2b640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 0x7f22a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.366+0000 7f22b9d2b640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 0x7f22a006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22ac006fd0 tx=0x7f22ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.369+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22a805a410 con 0x7f22b406e2c0 2024-04-16T12:55:20.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.553+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f22b4068a70 con 0x7f22b406e2c0 2024-04-16T12:55:20.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.554+0000 7f22b27fc640 1 -- 172.21.15.18:0/1702209942 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f22a8059d10 con 0x7f22b406e2c0 2024-04-16T12:55:20.555 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:20.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 msgr2=0x7f22a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 0x7f22a006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22ac006fd0 tx=0x7f22ac008040 comp rx=0 tx=0).stop 2024-04-16T12:55:20.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 msgr2=0x7f22b4152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22a800d800 tx=0x7f22a800dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 shutdown_connections 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22a006c8f0 0x7f22a006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22b40cd8a0 0x7f22b4152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22b406e2c0 0x7f22b4152570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 --2- 172.21.15.18:0/1702209942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b406dee0 0x7f22b40b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 >> 172.21.15.18:0/1702209942 conn(0x7f22b409aa10 msgr2=0x7f22b40d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 shutdown_connections 2024-04-16T12:55:20.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.556+0000 7f22bbf8f640 1 -- 172.21.15.18:0/1702209942 wait complete. 2024-04-16T12:55:20.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:20.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.676+0000 7f3d48582640 1 Processor -- start 2024-04-16T12:55:20.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.676+0000 7f3d48582640 1 -- start start 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d48582640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d4006c130 0x7f3d400d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d48582640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 0x7f3d400d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d48582640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d40163480 con 0x7f3d4015ef70 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d48582640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4015f350 con 0x7f3d4006c130 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d48582640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400d2470 con 0x7f3d400b3a00 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d45b1d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d4006c130 0x7f3d400d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d45b1d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d4006c130 0x7f3d400d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43578/0 (socket says 172.21.15.18:43578) 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d45b1d640 1 -- 172.21.15.18:0/692676326 learned_addr learned my addr 172.21.15.18:0/692676326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d45b1d640 1 -- 172.21.15.18:0/692676326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 msgr2=0x7f3d400d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.677+0000 7f3d46b1f640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 0x7f3d400d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d45b1d640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 0x7f3d400d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d45b1d640 1 -- 172.21.15.18:0/692676326 >> v1:172.21.15.104:6789/0 conn(0x7f3d4015ef70 legacy=0x7f3d4006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d45b1d640 1 -- 172.21.15.18:0/692676326 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40163760 con 0x7f3d4006c130 2024-04-16T12:55:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d46b1f640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 0x7f3d400d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d45b1d640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400d2ec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009870 tx=0x7f3d3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20110c2afe27e7f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d4531c640 1 -- 172.21.15.18:0/692676326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34035020 con 0x7f3d4006c130 2024-04-16T12:55:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d4531c640 1 -- 172.21.15.18:0/692676326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34031640 con 0x7f3d4006c130 2024-04-16T12:55:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.678+0000 7f3d4531c640 1 -- 172.21.15.18:0/692676326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3402d040 con 0x7f3d4006c130 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 -- 172.21.15.18:0/692676326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 msgr2=0x7f3d400d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400d2ec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009870 tx=0x7f3d3402b8f0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 -- 172.21.15.18:0/692676326 shutdown_connections 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d400b3a00 0x7f3d400d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 --2- 172.21.15.18:0/692676326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400d2ec0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 -- 172.21.15.18:0/692676326 >> 172.21.15.18:0/692676326 conn(0x7f3d400b69e0 msgr2=0x7f3d400d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 -- 172.21.15.18:0/692676326 shutdown_connections 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.679+0000 7f3d48582640 1 -- 172.21.15.18:0/692676326 wait complete. 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.680+0000 7f3d48582640 1 Processor -- start 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.680+0000 7f3d48582640 1 -- start start 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d400b3a00 0x7f3d4015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d4015ef70 0x7f3d4014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d5160 con 0x7f3d4006c130 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d2a30 con 0x7f3d400b3a00 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d48582640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400b34b0 con 0x7f3d4015ef70 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43594/0 (socket says 172.21.15.18:43594) 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 -- 172.21.15.18:0/3711918080 learned_addr learned my addr 172.21.15.18:0/3711918080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 -- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d4015ef70 msgr2=0x7f3d4014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d46b1f640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d4015ef70 0x7f3d4014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d4015ef70 0x7f3d4014fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 -- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d400b3a00 msgr2=0x7f3d4015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d400b3a00 0x7f3d4015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.681+0000 7f3d4631e640 1 -- 172.21.15.18:0/3711918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40160f50 con 0x7f3d4006c130 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d4631e640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b420 tx=0x7f3d3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011830 con 0x7f3d4006c130 2024-04-16T12:55:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d38016070 con 0x7f3d4006c130 2024-04-16T12:55:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011c10 con 0x7f3d4006c130 2024-04-16T12:55:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4015feb0 con 0x7f3d4006c130 2024-04-16T12:55:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.682+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d40160750 con 0x7f3d4006c130 2024-04-16T12:55:20.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.683+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d400d0870 con 0x7f3d4006c130 2024-04-16T12:55:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.683+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d3801b460 con 0x7f3d4006c130 2024-04-16T12:55:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.684+0000 7f3d3effd640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.684+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d3808b9c0 con 0x7f3d4006c130 2024-04-16T12:55:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.684+0000 7f3d45b1d640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.685+0000 7f3d45b1d640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d34036000 tx=0x7f3d34030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.688+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d400d0870 con 0x7f3d4006c130 2024-04-16T12:55:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.872+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3d400752b0 con 0x7f3d4006c130 2024-04-16T12:55:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.872+0000 7f3d3effd640 1 -- 172.21.15.18:0/3711918080 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f3d3808de20 con 0x7f3d4006c130 2024-04-16T12:55:20.874 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 msgr2=0x7f3d2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d34036000 tx=0x7f3d34030000 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 msgr2=0x7f3d400cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b420 tx=0x7f3d3800b8e0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 shutdown_connections 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d4015ef70 0x7f3d4014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d400b3a00 0x7f3d4015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 --2- 172.21.15.18:0/3711918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4006c130 0x7f3d400cd740 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 >> 172.21.15.18:0/3711918080 conn(0x7f3d400b69e0 msgr2=0x7f3d4015dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 shutdown_connections 2024-04-16T12:55:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.874+0000 7f3d48582640 1 -- 172.21.15.18:0/3711918080 wait complete. 2024-04-16T12:55:20.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:55:20.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.992+0000 7f0d4a982640 1 Processor -- start 2024-04-16T12:55:20.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.992+0000 7f0d4a982640 1 -- start start 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0d4415ed20 0x7f0d440cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440d4340 0x7f0d440b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0d440cf740 con 0x7f0d440d4340 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0d440cf8e0 con 0x7f0d4415ed20 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d4a982640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4415f100 con 0x7f0d440b3ec0 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d48f1f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440d4340 0x7f0d440b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d48f1f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440d4340 0x7f0d440b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43598/0 (socket says 172.21.15.18:43598) 2024-04-16T12:55:20.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.993+0000 7f0d48f1f640 1 -- 172.21.15.18:0/2968521297 learned_addr learned my addr 172.21.15.18:0/2968521297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:20.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d3bfff640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d43fff640 1 --2- 172.21.15.18:0/2968521297 >> v2:172.21.15.104:3300/0 conn(0x7f0d4415ed20 0x7f0d440cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d48f1f640 1 -- 172.21.15.18:0/2968521297 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 msgr2=0x7f0d440d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d48f1f640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d48f1f640 1 -- 172.21.15.18:0/2968521297 >> v2:172.21.15.104:3300/0 conn(0x7f0d4415ed20 msgr2=0x7f0d440cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d48f1f640 1 --2- 172.21.15.18:0/2968521297 >> v2:172.21.15.104:3300/0 conn(0x7f0d4415ed20 0x7f0d440cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.994+0000 7f0d48f1f640 1 -- 172.21.15.18:0/2968521297 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d440cfb30 con 0x7f0d440d4340 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d48f1f640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d440b6390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d4408d1a0 tx=0x7f0d3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435ad38d72839971 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d437fe640 1 -- 172.21.15.18:0/2968521297 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c02ca70 con 0x7f0d440d4340 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d437fe640 1 -- 172.21.15.18:0/2968521297 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c02cc10 con 0x7f0d440d4340 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d437fe640 1 -- 172.21.15.18:0/2968521297 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0343f0 con 0x7f0d440d4340 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 -- 172.21.15.18:0/2968521297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 msgr2=0x7f0d440b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:20.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d440b6390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d4408d1a0 tx=0x7f0d3c02bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 -- 172.21.15.18:0/2968521297 shutdown_connections 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d440b6390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 --2- 172.21.15.18:0/2968521297 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 --2- 172.21.15.18:0/2968521297 >> v2:172.21.15.104:3300/0 conn(0x7f0d4415ed20 0x7f0d440cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 -- 172.21.15.18:0/2968521297 >> 172.21.15.18:0/2968521297 conn(0x7f0d440d1390 msgr2=0x7f0d440d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 -- 172.21.15.18:0/2968521297 shutdown_connections 2024-04-16T12:55:21.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.995+0000 7f0d4a982640 1 -- 172.21.15.18:0/2968521297 wait complete. 2024-04-16T12:55:21.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 Processor -- start 2024-04-16T12:55:21.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 -- start start 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d4415ed20 0x7f0d440caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440d38e0 con 0x7f0d440d4340 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440d3600 con 0x7f0d4415ed20 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d4a982640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0d440d00f0 con 0x7f0d440b3ec0 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43612/0 (socket says 172.21.15.18:43612) 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.997+0000 7f0d3bfff640 1 -- 172.21.15.18:0/3331374807 learned_addr learned my addr 172.21.15.18:0/3331374807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d48f1f640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d4415ed20 0x7f0d440caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d43fff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 -- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 msgr2=0x7f0d440c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 -- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d4415ed20 msgr2=0x7f0d440caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d4415ed20 0x7f0d440caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 -- 172.21.15.18:0/3331374807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d440c9d30 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d43fff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d3bfff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00e870 tx=0x7f0d2c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c017070 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00ee60 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00cb80 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d440c9fb0 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.998+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d440ca270 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:20.999+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d440ca6b0 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.000+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d2c01a070 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.000+0000 7f0d417fa640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.000+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d2c08bbb0 con 0x7f0d440d4340 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.000+0000 7f0d43fff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.001+0000 7f0d43fff640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 0x7f0d2406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009b90 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.005+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d440c9d30 con 0x7f0d440d4340 2024-04-16T12:55:21.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.204+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d440752b0 con 0x7f0d440d4340 2024-04-16T12:55:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.204+0000 7f0d417fa640 1 -- 172.21.15.18:0/3331374807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f0d2c0596e0 con 0x7f0d440d4340 2024-04-16T12:55:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 msgr2=0x7f0d2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 0x7f0d2406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009b90 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 msgr2=0x7f0d441449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00e870 tx=0x7f0d2c00ed30 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 shutdown_connections 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d4415ed20 0x7f0d440caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440d4340 0x7f0d441449a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 --2- 172.21.15.18:0/3331374807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0d440b3ec0 0x7f0d440c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 >> 172.21.15.18:0/3331374807 conn(0x7f0d440d1390 msgr2=0x7f0d440b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 shutdown_connections 2024-04-16T12:55:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.206+0000 7f0d4a982640 1 -- 172.21.15.18:0/3331374807 wait complete. 2024-04-16T12:55:21.218 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:21.218 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:21.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:21.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.376+0000 7f922b442640 1 Processor -- start 2024-04-16T12:55:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.376+0000 7f922b442640 1 -- start start 2024-04-16T12:55:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f922b442640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f92240d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f922b442640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92241612e0 con 0x7f92240af2e0 2024-04-16T12:55:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f922b442640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240cd280 con 0x7f92240cec10 2024-04-16T12:55:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f922b442640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f92241615c0 con 0x7f922415ff60 2024-04-16T12:55:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f92299df640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f92240af2e0 0x7f92240af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39010/0 (socket says 172.21.15.18:39010) 2024-04-16T12:55:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.377+0000 7f92299df640 1 -- 172.21.15.18:0/3468483970 learned_addr learned my addr 172.21.15.18:0/3468483970 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:21.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92291de640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f92240d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021395422 0 0) 0x7f92241612e0 con 0x7f92240af2e0 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003520 con 0x7f92240af2e0 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4018923106 0 0) 0x7f920c003520 con 0x7f92240af2e0 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 msgr2=0x7f92240d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f92240d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 >> v1:172.21.15.104:6789/0 conn(0x7f92240cec10 legacy=0x7f92240cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92240cd560 con 0x7f92240af2e0 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f92140019f0 con 0x7f92240af2e0 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 >> v1:172.21.15.18:6789/0 conn(0x7f92240af2e0 legacy=0x7f92240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f920c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f920c003f60 0x7f920c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f920c004d40 0x7f920c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92241615c0 con 0x7f920c004d40 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0079a0 con 0x7f920c003f60 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f920c007ba0 con 0x7f922415ff60 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f920c004d40 0x7f920c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92291de640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f920c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92289dd640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f920c003f60 0x7f920c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 -- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 msgr2=0x7f920c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f922415ff60 0x7f920c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 -- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f920c003f60 msgr2=0x7f920c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f920c003f60 0x7f920c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.378+0000 7f92299df640 1 -- 172.21.15.18:0/3468483970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c003520 con 0x7f920c004d40 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.379+0000 7f92299df640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f920c004d40 0x7f920c0051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f921400a850 tx=0x7f920c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba74898788259c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.379+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400a4a0 con 0x7f920c004d40 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.379+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214034650 con 0x7f920c004d40 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.379+0000 7f9223fff640 1 -- 172.21.15.18:0/3468483970 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214034a80 con 0x7f920c004d40 2024-04-16T12:55:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 -- 172.21.15.18:0/3468483970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f920c004d40 msgr2=0x7f920c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 --2- 172.21.15.18:0/3468483970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f920c004d40 0x7f920c0051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f921400a850 tx=0x7f920c005830 comp rx=0 tx=0).stop 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f92299df640 1 -- 172.21.15.18:0/3468483970 reap_dead start 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 -- 172.21.15.18:0/3468483970 shutdown_connections 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 -- 172.21.15.18:0/3468483970 >> 172.21.15.18:0/3468483970 conn(0x7f92240b4160 msgr2=0x7f92240b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 -- 172.21.15.18:0/3468483970 shutdown_connections 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.380+0000 7f922b442640 1 -- 172.21.15.18:0/3468483970 wait complete. 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.381+0000 7f922b442640 1 Processor -- start 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.381+0000 7f922b442640 1 -- start start 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f92240b1770 0x7f92241416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92241595b0 0x7f9224159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f922409c0a0 con 0x7f9224141c00 2024-04-16T12:55:21.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f92240ce470 con 0x7f92241595b0 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f922b442640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f92240d0240 con 0x7f92240b1770 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43618/0 (socket says 172.21.15.18:43618) 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 -- 172.21.15.18:0/810934607 learned_addr learned my addr 172.21.15.18:0/810934607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92291de640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f92240b1770 0x7f92241416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92299df640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92241595b0 0x7f9224159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 -- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f92240b1770 msgr2=0x7f92241416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f92240b1770 0x7f92241416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 -- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92241595b0 msgr2=0x7f9224159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92241595b0 0x7f9224159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 -- 172.21.15.18:0/810934607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922415d8f0 con 0x7f9224141c00 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f92289dd640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f921800f820 tx=0x7f921800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.382+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180050d0 con 0x7f9224141c00 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.383+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9218018070 con 0x7f9224141c00 2024-04-16T12:55:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.383+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922415dbd0 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.383+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218005490 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.383+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922415e190 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.384+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224068a70 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.384+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f921800d730 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.385+0000 7f9221ffb640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 0x7f921006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.385+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f921808bce0 con 0x7f9224141c00 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.385+0000 7f92291de640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 0x7f921006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.385+0000 7f92291de640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 0x7f921006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92241f3a60 tx=0x7f921c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.389+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9218059dd0 con 0x7f9224141c00 2024-04-16T12:55:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.576+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92240b4dc0 con 0x7f9224141c00 2024-04-16T12:55:21.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.577+0000 7f9221ffb640 1 -- 172.21.15.18:0/810934607 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f92180596d0 con 0x7f9224141c00 2024-04-16T12:55:21.579 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:21.579 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 msgr2=0x7f921006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 0x7f921006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92241f3a60 tx=0x7f921c008040 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 msgr2=0x7f9224142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f921800f820 tx=0x7f921800fce0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 shutdown_connections 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f921006c920 0x7f921006ede0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92241595b0 0x7f9224159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9224141c00 0x7f9224142080 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 --2- 172.21.15.18:0/810934607 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f92240b1770 0x7f92241416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 >> 172.21.15.18:0/810934607 conn(0x7f92240b4160 msgr2=0x7f922409aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 shutdown_connections 2024-04-16T12:55:21.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.579+0000 7f922b442640 1 -- 172.21.15.18:0/810934607 wait complete. 2024-04-16T12:55:21.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:21.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.701+0000 7fab7389a640 1 Processor -- start 2024-04-16T12:55:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.701+0000 7fab7389a640 1 -- start start 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c1462c0 0x7fab6c072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fab6c0cd1d0 0x7fab6c160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c0cd640 con 0x7fab6c1462c0 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c070c90 con 0x7fab6c0cd1d0 2024-04-16T12:55:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab7389a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c0706d0 con 0x7fab6c06ff60 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c1462c0 0x7fab6c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c1462c0 0x7fab6c072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43624/0 (socket says 172.21.15.18:43624) 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 -- 172.21.15.18:0/3924915353 learned_addr learned my addr 172.21.15.18:0/3924915353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab70e35640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71e37640 1 --2- 172.21.15.18:0/3924915353 >> v2:172.21.15.104:3300/0 conn(0x7fab6c0cd1d0 0x7fab6c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 -- 172.21.15.18:0/3924915353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 msgr2=0x7fab6c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c0ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 -- 172.21.15.18:0/3924915353 >> v2:172.21.15.104:3300/0 conn(0x7fab6c0cd1d0 msgr2=0x7fab6c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 --2- 172.21.15.18:0/3924915353 >> v2:172.21.15.104:3300/0 conn(0x7fab6c0cd1d0 0x7fab6c160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.702+0000 7fab71636640 1 -- 172.21.15.18:0/3924915353 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0709b0 con 0x7fab6c1462c0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.703+0000 7fab71636640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c072500 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab6c073da0 tx=0x7fab6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83ced95cf33ee11 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.703+0000 7fab63fff640 1 -- 172.21.15.18:0/3924915353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68035020 con 0x7fab6c1462c0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.703+0000 7fab63fff640 1 -- 172.21.15.18:0/3924915353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68031870 con 0x7fab6c1462c0 2024-04-16T12:55:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.703+0000 7fab63fff640 1 -- 172.21.15.18:0/3924915353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68031c40 con 0x7fab6c1462c0 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 -- 172.21.15.18:0/3924915353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 msgr2=0x7fab6c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c072500 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab6c073da0 tx=0x7fab6802b910 comp rx=0 tx=0).stop 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 -- 172.21.15.18:0/3924915353 shutdown_connections 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 --2- 172.21.15.18:0/3924915353 >> v2:172.21.15.104:3300/0 conn(0x7fab6c0cd1d0 0x7fab6c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 --2- 172.21.15.18:0/3924915353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c072500 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 -- 172.21.15.18:0/3924915353 >> 172.21.15.18:0/3924915353 conn(0x7fab6c0d2640 msgr2=0x7fab6c0d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 -- 172.21.15.18:0/3924915353 shutdown_connections 2024-04-16T12:55:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.704+0000 7fab7389a640 1 -- 172.21.15.18:0/3924915353 wait complete. 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.705+0000 7fab7389a640 1 Processor -- start 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.705+0000 7fab7389a640 1 -- start start 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 0x7fab6c1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0703c0 con 0x7fab6c1462c0 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0d0600 con 0x7fab6c0cd1d0 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c160860 con 0x7fab6c06ff60 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43638/0 (socket says 172.21.15.18:43638) 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 -- 172.21.15.18:0/1818822006 learned_addr learned my addr 172.21.15.18:0/1818822006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71636640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab70e35640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 0x7fab6c1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 -- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 msgr2=0x7fab6c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 -- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 msgr2=0x7fab6c1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 0x7fab6c1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 -- 172.21.15.18:0/1818822006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c15cfd0 con 0x7fab6c1462c0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab70e35640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 0x7fab6c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71636640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab71e37640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab6400cda0 tx=0x7fab6400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64003b90 con 0x7fab6c1462c0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab64003d30 con 0x7fab6c1462c0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c15d2b0 con 0x7fab6c1462c0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.706+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64004240 con 0x7fab6c1462c0 2024-04-16T12:55:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.707+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c15d870 con 0x7fab6c1462c0 2024-04-16T12:55:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.707+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c0752b0 con 0x7fab6c1462c0 2024-04-16T12:55:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.708+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab640043e0 con 0x7fab6c1462c0 2024-04-16T12:55:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.708+0000 7fab61ffb640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 0x7fab5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.708+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fab6408cac0 con 0x7fab6c1462c0 2024-04-16T12:55:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.709+0000 7fab71636640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 0x7fab5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.709+0000 7fab71636640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 0x7fab5006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab68036000 tx=0x7fab6803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:21.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.712+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab6401d340 con 0x7fab6c1462c0 2024-04-16T12:55:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.897+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab6c070e60 con 0x7fab6c1462c0 2024-04-16T12:55:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.897+0000 7fab61ffb640 1 -- 172.21.15.18:0/1818822006 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fab6405aa90 con 0x7fab6c1462c0 2024-04-16T12:55:21.899 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 msgr2=0x7fab5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 0x7fab5006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fab68036000 tx=0x7fab6803c040 comp rx=0 tx=0).stop 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 msgr2=0x7fab6c13df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab6400cda0 tx=0x7fab6400a660 comp rx=0 tx=0).stop 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 shutdown_connections 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab5006c8f0 0x7fab5006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c1462c0 0x7fab6c13df70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0cd1d0 0x7fab6c1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 --2- 172.21.15.18:0/1818822006 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab6c06ff60 0x7fab6c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.899+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 >> 172.21.15.18:0/1818822006 conn(0x7fab6c0d2640 msgr2=0x7fab6c0d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.900+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 shutdown_connections 2024-04-16T12:55:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:21.900+0000 7fab7389a640 1 -- 172.21.15.18:0/1818822006 wait complete. 2024-04-16T12:55:21.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:22.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.018+0000 7f21435ca640 1 Processor -- start 2024-04-16T12:55:22.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.018+0000 7f21435ca640 1 -- start start 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f21435ca640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f213c0ccd80 0x7f213c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f21435ca640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213c15cc00 con 0x7f213c15c820 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f21435ca640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213c160a30 con 0x7f213c0b48c0 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f21435ca640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f213c160d10 con 0x7f213c0ccd80 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f2141366640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f213c15c820 0x7f213c0b41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39022/0 (socket says 172.21.15.18:39022) 2024-04-16T12:55:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.019+0000 7f2141366640 1 -- 172.21.15.18:0/1255422693 learned_addr learned my addr 172.21.15.18:0/1255422693 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141b67640 1 --2- 172.21.15.18:0/1255422693 >> v2:172.21.15.104:3300/0 conn(0x7f213c0ccd80 0x7f213c1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184794628 0 0) 0x7f213c15cc00 con 0x7f213c15c820 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2124003520 con 0x7f213c15c820 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4002720708 0 0) 0x7f2124003520 con 0x7f213c15c820 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 >> v2:172.21.15.104:3300/0 conn(0x7f213c0ccd80 msgr2=0x7f213c1603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 --2- 172.21.15.18:0/1255422693 >> v2:172.21.15.104:3300/0 conn(0x7f213c0ccd80 0x7f213c1603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 >> v1:172.21.15.104:6789/0 conn(0x7f213c0b48c0 legacy=0x7f213c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c160ff0 con 0x7f213c15c820 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f2134001670 con 0x7f213c15c820 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 >> v1:172.21.15.18:6789/0 conn(0x7f213c15c820 legacy=0x7f213c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 0x7f2124003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2124004800 0x7f2124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240051c0 0x7f212400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f213c160d10 con 0x7f21240039b0 2024-04-16T12:55:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f212400c160 con 0x7f2124004800 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f212400c360 con 0x7f21240051c0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 0x7f2124003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2140b65640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2124004800 0x7f2124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141b67640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240051c0 0x7f212400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 -- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240051c0 msgr2=0x7f212400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240051c0 0x7f212400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 -- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2124004800 msgr2=0x7f2124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2124004800 0x7f2124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141b67640 1 -- 172.21.15.18:0/1255422693 reap_dead start 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.020+0000 7f2141366640 1 -- 172.21.15.18:0/1255422693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124003520 con 0x7f21240039b0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.021+0000 7f2141366640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 0x7f2124003dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f213400c210 tx=0x7f2124005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1168fb03c10a3f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.021+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134007d30 con 0x7f21240039b0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.021+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134030070 con 0x7f21240039b0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.021+0000 7f213bfff640 1 -- 172.21.15.18:0/1255422693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134005d70 con 0x7f21240039b0 2024-04-16T12:55:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 -- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 msgr2=0x7f2124003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 0x7f2124003dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f213400c210 tx=0x7f2124005830 comp rx=0 tx=0).stop 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 -- 172.21.15.18:0/1255422693 shutdown_connections 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 --2- 172.21.15.18:0/1255422693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21240039b0 0x7f2124003dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 -- 172.21.15.18:0/1255422693 >> 172.21.15.18:0/1255422693 conn(0x7f213c0cf1b0 msgr2=0x7f213c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 -- 172.21.15.18:0/1255422693 shutdown_connections 2024-04-16T12:55:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.022+0000 7f21435ca640 1 -- 172.21.15.18:0/1255422693 wait complete. 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.023+0000 7f21435ca640 1 Processor -- start 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.023+0000 7f21435ca640 1 -- start start 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240039b0 0x7f213c1f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f213c0c80a0 0x7f213c0b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f213c1603c0 con 0x7f213c156ae0 2024-04-16T12:55:22.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f213c0b8260 con 0x7f213c0c80a0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f21435ca640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f213c160540 con 0x7f21240039b0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43654/0 (socket says 172.21.15.18:43654) 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 -- 172.21.15.18:0/265348967 learned_addr learned my addr 172.21.15.18:0/265348967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2140b65640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f213c0c80a0 0x7f213c0b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141366640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240039b0 0x7f213c1f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 -- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240039b0 msgr2=0x7f213c1f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240039b0 0x7f213c1f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 -- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f213c0c80a0 msgr2=0x7f213c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f213c0c80a0 0x7f213c0b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 -- 172.21.15.18:0/265348967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c0b6220 con 0x7f213c156ae0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.024+0000 7f2141b67640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c0b8860 tx=0x7f212c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.025+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c00fdb0 con 0x7f213c156ae0 2024-04-16T12:55:22.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.025+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c015430 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.025+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213c0c8580 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.025+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c015820 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.025+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213c0c8b40 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.026+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213c068a70 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.026+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f212c0159c0 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.027+0000 7f2139ffb640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 0x7f212806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.027+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f212c08cbe0 con 0x7f213c156ae0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.027+0000 7f2141366640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 0x7f212806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.027+0000 7f2141366640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 0x7f212806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2134034000 tx=0x7f2134039040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.031+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f212c019030 con 0x7f213c156ae0 2024-04-16T12:55:22.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.215+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f213c15c040 con 0x7f213c156ae0 2024-04-16T12:55:22.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.216+0000 7f2139ffb640 1 -- 172.21.15.18:0/265348967 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f212c010040 con 0x7f213c156ae0 2024-04-16T12:55:22.217 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 msgr2=0x7f212806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 0x7f212806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2134034000 tx=0x7f2134039040 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 msgr2=0x7f213c0c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c0b8860 tx=0x7f212c00f580 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 shutdown_connections 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f212806c8f0 0x7f212806edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f213c156ae0 0x7f213c0c6230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f213c0c80a0 0x7f213c0b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 --2- 172.21.15.18:0/265348967 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21240039b0 0x7f213c1f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 >> 172.21.15.18:0/265348967 conn(0x7f213c0cf1b0 msgr2=0x7f213c15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 shutdown_connections 2024-04-16T12:55:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.218+0000 7f21435ca640 1 -- 172.21.15.18:0/265348967 wait complete. 2024-04-16T12:55:22.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.335+0000 7fe8e7e88640 1 Processor -- start 2024-04-16T12:55:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e7e88640 1 -- start start 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e7e88640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe8e00b4100 0x7fe8e00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e7e88640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e015d5f0 con 0x7fe8e015ce50 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e7e88640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e015d8d0 con 0x7fe8e00cd170 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e7e88640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e00b4a70 con 0x7fe8e00b4100 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e6425640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe8e00b4100 0x7fe8e00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e5423640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe8e015ce50 0x7fe8e0160b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39032/0 (socket says 172.21.15.18:39032) 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.336+0000 7fe8e5423640 1 -- 172.21.15.18:0/2664980128 learned_addr learned my addr 172.21.15.18:0/2664980128 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.337+0000 7fe8e6425640 1 -- 172.21.15.18:0/2664980128 >> v1:172.21.15.104:6789/0 conn(0x7fe8e00cd170 legacy=0x7fe8e00cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.337+0000 7fe8e6425640 1 -- 172.21.15.18:0/2664980128 >> v1:172.21.15.18:6789/0 conn(0x7fe8e015ce50 legacy=0x7fe8e0160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.337+0000 7fe8e6425640 1 -- 172.21.15.18:0/2664980128 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e015dbb0 con 0x7fe8e00b4100 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.337+0000 7fe8e6425640 1 --2- 172.21.15.18:0/2664980128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e00b4530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128894b6bf94f690 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e4c22640 1 -- 172.21.15.18:0/2664980128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0039070 con 0x7fe8e00b4100 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e4c22640 1 -- 172.21.15.18:0/2664980128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d002cd00 con 0x7fe8e00b4100 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e4c22640 1 -- 172.21.15.18:0/2664980128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0034660 con 0x7fe8e00b4100 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2664980128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 msgr2=0x7fe8e00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2664980128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e00b4530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d002bf50 comp rx=0 tx=0).stop 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2664980128 shutdown_connections 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2664980128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e00b4530 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2664980128 >> 172.21.15.18:0/2664980128 conn(0x7fe8e00cf100 msgr2=0x7fe8e00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2664980128 shutdown_connections 2024-04-16T12:55:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.338+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2664980128 wait complete. 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.339+0000 7fe8e7e88640 1 Processor -- start 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 -- start start 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 0x7fe8e00d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8e015ce50 0x7fe8e00d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0161260 con 0x7fe8e00b4100 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e015d300 con 0x7fe8e00cd170 2024-04-16T12:55:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e7e88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e00d0250 con 0x7fe8e015ce50 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e5c24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e5c24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43658/0 (socket says 172.21.15.18:43658) 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e5c24640 1 -- 172.21.15.18:0/2086417025 learned_addr learned my addr 172.21.15.18:0/2086417025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e6425640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8e015ce50 0x7fe8e00d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.340+0000 7fe8e5423640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 0x7fe8e00d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 -- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8e015ce50 msgr2=0x7fe8e00d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8e015ce50 0x7fe8e00d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 -- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 msgr2=0x7fe8e00d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 0x7fe8e00d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 -- 172.21.15.18:0/2086417025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e00c8260 con 0x7fe8e00b4100 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5423640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 0x7fe8e00d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e5c24640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c400 tx=0x7fe8d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80052d0 con 0x7fe8e00b4100 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d8005490 con 0x7fe8e00b4100 2024-04-16T12:55:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e00c8540 con 0x7fe8e00b4100 2024-04-16T12:55:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007260 con 0x7fe8e00b4100 2024-04-16T12:55:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.341+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e00c8b00 con 0x7fe8e00b4100 2024-04-16T12:55:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.342+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e0068a70 con 0x7fe8e00b4100 2024-04-16T12:55:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.342+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8d8007400 con 0x7fe8e00b4100 2024-04-16T12:55:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.343+0000 7fe8de7fc640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 0x7fe8cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.343+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8d808b410 con 0x7fe8e00b4100 2024-04-16T12:55:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.343+0000 7fe8e5423640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 0x7fe8cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.344+0000 7fe8e5423640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 0x7fe8cc06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0156ab0 tx=0x7fe8d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.347+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe8d8058e10 con 0x7fe8e00b4100 2024-04-16T12:55:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.533+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8e00cfee0 con 0x7fe8e00b4100 2024-04-16T12:55:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.533+0000 7fe8de7fc640 1 -- 172.21.15.18:0/2086417025 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fe8d805d110 con 0x7fe8e00b4100 2024-04-16T12:55:22.535 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 msgr2=0x7fe8cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 0x7fe8cc06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0156ab0 tx=0x7fe8d4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 msgr2=0x7fe8e0149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c400 tx=0x7fe8d800c8c0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 shutdown_connections 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8cc06c8f0 0x7fe8cc06edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8e015ce50 0x7fe8e00d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8e00cd170 0x7fe8e00d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 --2- 172.21.15.18:0/2086417025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8e00b4100 0x7fe8e0149960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 >> 172.21.15.18:0/2086417025 conn(0x7fe8e00cf100 msgr2=0x7fe8e015fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 shutdown_connections 2024-04-16T12:55:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.535+0000 7fe8e7e88640 1 -- 172.21.15.18:0/2086417025 wait complete. 2024-04-16T12:55:22.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:22.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.655+0000 7f2301d9d640 1 Processor -- start 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.655+0000 7f2301d9d640 1 -- start start 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f2301d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22fc06e200 0x7f22fc0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f2301d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 0x7f22fc1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f2301d9d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc0aedf0 con 0x7f22fc0b5100 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f2301d9d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc0af0d0 con 0x7f22fc06e200 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f2301d9d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc1457f0 con 0x7f22fc0d1950 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22fc06e200 0x7f22fc0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22fc06e200 0x7f22fc0ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43666/0 (socket says 172.21.15.18:43666) 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 -- 172.21.15.18:0/988339093 learned_addr learned my addr 172.21.15.18:0/988339093 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fbfff640 1 --2- 172.21.15.18:0/988339093 >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 0x7f22fc1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 -- 172.21.15.18:0/988339093 >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 msgr2=0x7f22fc1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 --2- 172.21.15.18:0/988339093 >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 0x7f22fc1462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 -- 172.21.15.18:0/988339093 >> v1:172.21.15.104:6789/0 conn(0x7f22fc0b5100 legacy=0x7f22fc0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fb7fe640 1 -- 172.21.15.18:0/988339093 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc145ad0 con 0x7f22fc06e200 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.656+0000 7f22fbfff640 1 --2- 172.21.15.18:0/988339093 >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 0x7f22fc1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.657+0000 7f22fb7fe640 1 --2- 172.21.15.18:0/988339093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc0ae4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22fc073ab0 tx=0x7f22ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32d798870586de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.657+0000 7f22faffd640 1 -- 172.21.15.18:0/988339093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec034070 con 0x7f22fc06e200 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.657+0000 7f22faffd640 1 -- 172.21.15.18:0/988339093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec030860 con 0x7f22fc06e200 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.657+0000 7f22faffd640 1 -- 172.21.15.18:0/988339093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec030c30 con 0x7f22fc06e200 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 -- 172.21.15.18:0/988339093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 msgr2=0x7f22fc0ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 --2- 172.21.15.18:0/988339093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc0ae4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22fc073ab0 tx=0x7f22ec02b9a0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 -- 172.21.15.18:0/988339093 shutdown_connections 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 --2- 172.21.15.18:0/988339093 >> v2:172.21.15.104:3300/0 conn(0x7f22fc0d1950 0x7f22fc1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 --2- 172.21.15.18:0/988339093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc0ae4f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 -- 172.21.15.18:0/988339093 >> 172.21.15.18:0/988339093 conn(0x7f22fc073590 msgr2=0x7f22fc0b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 -- 172.21.15.18:0/988339093 shutdown_connections 2024-04-16T12:55:22.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.658+0000 7f2301d9d640 1 -- 172.21.15.18:0/988339093 wait complete. 2024-04-16T12:55:22.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.659+0000 7f2301d9d640 1 Processor -- start 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.659+0000 7f2301d9d640 1 -- start start 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 0x7f22fc1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22fc0d1950 0x7f22fc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0aebb0 con 0x7f22fc06e200 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0aea30 con 0x7f22fc0b5100 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f2301d9d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc146810 con 0x7f22fc0d1950 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43676/0 (socket says 172.21.15.18:43676) 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 -- 172.21.15.18:0/3589071722 learned_addr learned my addr 172.21.15.18:0/3589071722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 -- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22fc0d1950 msgr2=0x7f22fc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22fc0d1950 0x7f22fc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 -- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 msgr2=0x7f22fc1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22f2ffd640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 0x7f22fc1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 0x7f22fc1524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22fb7fe640 1 -- 172.21.15.18:0/3589071722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc151430 con 0x7f22fc06e200 2024-04-16T12:55:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.660+0000 7f22f2ffd640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 0x7f22fc1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f22fb7fe640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22ec02b9e0 tx=0x7f22ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec048070 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec030660 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec034040 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc151710 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.661+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22fc151cd0 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.662+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22fc068a70 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.662+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22ec037070 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.663+0000 7f22f8ff9640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 0x7f22dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.663+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f22ec0addc0 con 0x7f22fc06e200 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.663+0000 7f22f2ffd640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 0x7f22dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.663+0000 7f22f2ffd640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 0x7f22dc06ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22fc1f8000 tx=0x7f22e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.667+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22ec07bf30 con 0x7f22fc06e200 2024-04-16T12:55:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.851+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f22fc146120 con 0x7f22fc06e200 2024-04-16T12:55:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.851+0000 7f22f8ff9640 1 -- 172.21.15.18:0/3589071722 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f22ec030830 con 0x7f22fc06e200 2024-04-16T12:55:22.853 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 msgr2=0x7f22dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 0x7f22dc06ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f22fc1f8000 tx=0x7f22e4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 msgr2=0x7f22fc154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22ec02b9e0 tx=0x7f22ec004730 comp rx=0 tx=0).stop 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 shutdown_connections 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f22dc06c920 0x7f22dc06ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f22fc0d1950 0x7f22fc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22fc0b5100 0x7f22fc1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 --2- 172.21.15.18:0/3589071722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22fc06e200 0x7f22fc154490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.853+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 >> 172.21.15.18:0/3589071722 conn(0x7f22fc073590 msgr2=0x7f22fc06d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.854+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 shutdown_connections 2024-04-16T12:55:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.854+0000 7f2301d9d640 1 -- 172.21.15.18:0/3589071722 wait complete. 2024-04-16T12:55:22.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:55:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.980+0000 7f29353a8640 1 Processor -- start 2024-04-16T12:55:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.980+0000 7f29353a8640 1 -- start start 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f29353a8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29300ce280 0x7f29300af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f29353a8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f293015cb60 con 0x7f293015c780 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f29353a8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f293006e8c0 con 0x7f29300ae540 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f29353a8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f293006f1f0 con 0x7f29300ce280 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f292e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29300ce280 0x7f29300af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f292effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f293015c780 0x7f29300ade30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39046/0 (socket says 172.21.15.18:39046) 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.981+0000 7f292effd640 1 -- 172.21.15.18:0/248847246 learned_addr learned my addr 172.21.15.18:0/248847246 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.982+0000 7f292e7fc640 1 -- 172.21.15.18:0/248847246 >> v1:172.21.15.104:6789/0 conn(0x7f29300ae540 legacy=0x7f293006f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.982+0000 7f292e7fc640 1 -- 172.21.15.18:0/248847246 >> v1:172.21.15.18:6789/0 conn(0x7f293015c780 legacy=0x7f29300ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.982+0000 7f292e7fc640 1 -- 172.21.15.18:0/248847246 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293006eba0 con 0x7f29300ce280 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.982+0000 7f292e7fc640 1 --2- 172.21.15.18:0/248847246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ce280 0x7f29300af840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f29180097a0 tx=0x7f291802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f3fc405e9ca4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f292dffb640 1 -- 172.21.15.18:0/248847246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918034070 con 0x7f29300ce280 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f292dffb640 1 -- 172.21.15.18:0/248847246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2918030610 con 0x7f29300ce280 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f292dffb640 1 -- 172.21.15.18:0/248847246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180309e0 con 0x7f29300ce280 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 -- 172.21.15.18:0/248847246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ce280 msgr2=0x7f29300af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 --2- 172.21.15.18:0/248847246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ce280 0x7f29300af840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f29180097a0 tx=0x7f291802b960 comp rx=0 tx=0).stop 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 -- 172.21.15.18:0/248847246 shutdown_connections 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 --2- 172.21.15.18:0/248847246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ce280 0x7f29300af840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 -- 172.21.15.18:0/248847246 >> 172.21.15.18:0/248847246 conn(0x7f2930073670 msgr2=0x7f293006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 -- 172.21.15.18:0/248847246 shutdown_connections 2024-04-16T12:55:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.983+0000 7f29353a8640 1 -- 172.21.15.18:0/248847246 wait complete. 2024-04-16T12:55:22.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.984+0000 7f29353a8640 1 Processor -- start 2024-04-16T12:55:22.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 -- start start 2024-04-16T12:55:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29300ce280 0x7f293009dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 0x7f293009dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29300afe60 con 0x7f29300ae540 2024-04-16T12:55:22.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f29300cd440 con 0x7f293015c780 2024-04-16T12:55:22.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f29353a8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f29300ae9f0 con 0x7f29300ce280 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f292effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f292effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43686/0 (socket says 172.21.15.18:43686) 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.985+0000 7f292effd640 1 -- 172.21.15.18:0/4155646013 learned_addr learned my addr 172.21.15.18:0/4155646013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292f7fe640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 0x7f293009dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292e7fc640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29300ce280 0x7f293009dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 -- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29300ce280 msgr2=0x7f293009dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29300ce280 0x7f293009dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 -- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 msgr2=0x7f293009dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 0x7f293009dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 -- 172.21.15.18:0/4155646013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293009e600 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292f7fe640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 0x7f293009dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f292effd640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f292800c480 tx=0x7f292800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928017070 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928005ce0 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29280072f0 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293009e8e0 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.986+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293009eea0 con 0x7f29300ae540 2024-04-16T12:55:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.987+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293015bc70 con 0x7f29300ae540 2024-04-16T12:55:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.987+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f292801a070 con 0x7f29300ae540 2024-04-16T12:55:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.988+0000 7f29277fe640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.988+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f292808b140 con 0x7f29300ae540 2024-04-16T12:55:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.988+0000 7f292e7fc640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.989+0000 7f292e7fc640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 0x7f291006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2918036000 tx=0x7f291803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:22.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:22.992+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f293015bc70 con 0x7f29300ae540 2024-04-16T12:55:23.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.188+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2930068a70 con 0x7f29300ae540 2024-04-16T12:55:23.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.188+0000 7f29277fe640 1 -- 172.21.15.18:0/4155646013 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f2928058bd0 con 0x7f29300ae540 2024-04-16T12:55:23.189 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:55:23.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 msgr2=0x7f291006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:23.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 0x7f291006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2918036000 tx=0x7f291803b040 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 msgr2=0x7f293006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f292800c480 tx=0x7f292800c940 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 shutdown_connections 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f291006c8f0 0x7f291006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f293015c780 0x7f293009dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f29300ce280 0x7f293009dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 --2- 172.21.15.18:0/4155646013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29300ae540 0x7f293006c680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 >> 172.21.15.18:0/4155646013 conn(0x7f2930073670 msgr2=0x7f29300b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 shutdown_connections 2024-04-16T12:55:23.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:23.190+0000 7f29353a8640 1 -- 172.21.15.18:0/4155646013 wait complete. 2024-04-16T12:55:23.202 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-04-16T12:55:23.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:23.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-16T12:55:23.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[44195]: fuse finished with error 0 and tester_r 0 2024-04-16T12:55:23.231 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:55:29.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:55:29.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:29.333 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-16T12:55:29.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.515+0000 7f7737c62640 1 Processor -- start 2024-04-16T12:55:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.515+0000 7f7737c62640 1 -- start start 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f7737c62640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77300cd910 0x7f77300cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f7737c62640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 0x7f773006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f7737c62640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7730144dc0 con 0x7f77301449e0 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f7737c62640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f773006d3a0 con 0x7f77300cd910 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f7737c62640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f773015c400 con 0x7f773006ca30 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f77359fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f77301449e0 0x7f773015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34562/0 (socket says 172.21.15.18:34562) 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f77351fd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77300cd910 0x7f77300cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f77359fe640 1 -- 172.21.15.18:0/3952172346 learned_addr learned my addr 172.21.15.18:0/3952172346 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f77351fd640 1 -- 172.21.15.18:0/3952172346 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 msgr2=0x7f773006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.516+0000 7f77361ff640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 0x7f773006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77349fc640 1 -- 172.21.15.18:0/3952172346 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543388702 0 0) 0x7f7730144dc0 con 0x7f77301449e0 2024-04-16T12:55:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77351fd640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 0x7f773006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77351fd640 1 -- 172.21.15.18:0/3952172346 >> v1:172.21.15.18:6789/0 conn(0x7f77301449e0 legacy=0x7f773015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77351fd640 1 -- 172.21.15.18:0/3952172346 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77300b3fb0 con 0x7f77300cd910 2024-04-16T12:55:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77361ff640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 0x7f773006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77351fd640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300cd910 0x7f77300cdda0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77200097a0 tx=0x7f772002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2501bd9e9727ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.517+0000 7f77349fc640 1 -- 172.21.15.18:0/3952172346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720035020 con 0x7f77300cd910 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f77349fc640 1 -- 172.21.15.18:0/3952172346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720031830 con 0x7f77300cd910 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f77349fc640 1 -- 172.21.15.18:0/3952172346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720031c00 con 0x7f77300cd910 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 -- 172.21.15.18:0/3952172346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300cd910 msgr2=0x7f77300cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300cd910 0x7f77300cdda0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77200097a0 tx=0x7f772002b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 -- 172.21.15.18:0/3952172346 shutdown_connections 2024-04-16T12:55:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f773006ca30 0x7f773006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 --2- 172.21.15.18:0/3952172346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300cd910 0x7f77300cdda0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 -- 172.21.15.18:0/3952172346 >> 172.21.15.18:0/3952172346 conn(0x7f7730071f70 msgr2=0x7f7730072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:29.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 -- 172.21.15.18:0/3952172346 shutdown_connections 2024-04-16T12:55:29.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.518+0000 7f7737c62640 1 -- 172.21.15.18:0/3952172346 wait complete. 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.519+0000 7f7737c62640 1 Processor -- start 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 -- start start 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f77300cd910 0x7f77301e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77301449e0 0x7f773012d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77300b4850 con 0x7f773006ca30 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f77300b4570 con 0x7f77301449e0 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f7737c62640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f77300b4b30 con 0x7f77300cd910 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f77359fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f77359fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45430/0 (socket says 172.21.15.18:45430) 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f77359fe640 1 -- 172.21.15.18:0/769700435 learned_addr learned my addr 172.21.15.18:0/769700435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.520+0000 7f77351fd640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f77300cd910 0x7f77301e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77361ff640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77301449e0 0x7f773012d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 -- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f77300cd910 msgr2=0x7f77301e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f77300cd910 0x7f77301e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 -- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77301449e0 msgr2=0x7f773012d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77301449e0 0x7f773012d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 -- 172.21.15.18:0/769700435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77301e53d0 con 0x7f773006ca30 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77359fe640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c400 tx=0x7f772c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c017070 con 0x7f773006ca30 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c005ce0 con 0x7f773006ca30 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77301e56b0 con 0x7f773006ca30 2024-04-16T12:55:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c007310 con 0x7f773006ca30 2024-04-16T12:55:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.521+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77301e5c70 con 0x7f773006ca30 2024-04-16T12:55:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.522+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77301e5fa0 con 0x7f773006ca30 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.523+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f772c01a070 con 0x7f773006ca30 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.523+0000 7f77267fc640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 0x7f771406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.523+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f772c08b210 con 0x7f773006ca30 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.523+0000 7f77351fd640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 0x7f771406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.524+0000 7f77351fd640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 0x7f771406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7720036000 tx=0x7f7720008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.528+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f772c058cb0 con 0x7f773006ca30 2024-04-16T12:55:29.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.718+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77300752b0 con 0x7f773006ca30 2024-04-16T12:55:29.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.719+0000 7f77267fc640 1 -- 172.21.15.18:0/769700435 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f772c05cfb0 con 0x7f773006ca30 2024-04-16T12:55:29.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:29.721 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 msgr2=0x7f771406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 0x7f771406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7720036000 tx=0x7f7720008030 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 msgr2=0x7f77301e6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c400 tx=0x7f772c00c8c0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 shutdown_connections 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f771406c8f0 0x7f771406edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77301449e0 0x7f773012d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f77300cd910 0x7f77301e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 --2- 172.21.15.18:0/769700435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773006ca30 0x7f77301e6470 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 >> 172.21.15.18:0/769700435 conn(0x7f7730071f70 msgr2=0x7f77301e8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 shutdown_connections 2024-04-16T12:55:29.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.721+0000 7f7737c62640 1 -- 172.21.15.18:0/769700435 wait complete. 2024-04-16T12:55:29.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:29.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.838+0000 7f3d1db9d640 1 Processor -- start 2024-04-16T12:55:29.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 -- start start 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d1815ea00 0x7f3d180d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d180d2a60 con 0x7f3d180b6190 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1815ede0 con 0x7f3d1815ea00 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1db9d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d180d2d40 con 0x7f3d180b87b0 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.839+0000 7f3d1cb9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d1815ea00 0x7f3d180d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d1815ea00 0x7f3d180d3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45432/0 (socket says 172.21.15.18:45432) 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 -- 172.21.15.18:0/1754704697 learned_addr learned my addr 172.21.15.18:0/1754704697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1d39c640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 -- 172.21.15.18:0/1754704697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 msgr2=0x7f3d180b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:29.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 -- 172.21.15.18:0/1754704697 >> v1:172.21.15.104:6789/0 conn(0x7f3d180b6190 legacy=0x7f3d1806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.840+0000 7f3d1cb9b640 1 -- 172.21.15.18:0/1754704697 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180d3020 con 0x7f3d1815ea00 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1cb9b640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180d3d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009870 tx=0x7f3d0c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2388ee4f5787f795 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d177fe640 1 -- 172.21.15.18:0/1754704697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c034070 con 0x7f3d1815ea00 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d177fe640 1 -- 172.21.15.18:0/1754704697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c030840 con 0x7f3d1815ea00 2024-04-16T12:55:29.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d177fe640 1 -- 172.21.15.18:0/1754704697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c030c10 con 0x7f3d1815ea00 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1754704697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 msgr2=0x7f3d180d3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180d3d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009870 tx=0x7f3d0c02b980 comp rx=0 tx=0).stop 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1754704697 shutdown_connections 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1754704697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180d3d70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1754704697 >> 172.21.15.18:0/1754704697 conn(0x7f3d180d1190 msgr2=0x7f3d180d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1754704697 shutdown_connections 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.841+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1754704697 wait complete. 2024-04-16T12:55:29.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.842+0000 7f3d1db9d640 1 Processor -- start 2024-04-16T12:55:29.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 -- start start 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d180b6190 0x7f3d18154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180b3b60 con 0x7f3d1815ea00 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180d35e0 con 0x7f3d180b6190 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.843+0000 7f3d1db9d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d180b3ce0 con 0x7f3d180b87b0 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45434/0 (socket says 172.21.15.18:45434) 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 -- 172.21.15.18:0/1432387029 learned_addr learned my addr 172.21.15.18:0/1432387029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1cb9b640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d180b6190 0x7f3d18154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d17fff640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 -- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 msgr2=0x7f3d180cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 -- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d180b6190 msgr2=0x7f3d18154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d180b6190 0x7f3d18154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 -- 172.21.15.18:0/1432387029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180ab150 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1d39c640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007e60 tx=0x7f3d1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10014420 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10019070 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d180ab430 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10014820 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.844+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d180ab9f0 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.845+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d180abbf0 con 0x7f3d1815ea00 2024-04-16T12:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.846+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d100149c0 con 0x7f3d1815ea00 2024-04-16T12:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.846+0000 7f3d157fa640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 0x7f3cfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.846+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d1008c4c0 con 0x7f3d1815ea00 2024-04-16T12:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.847+0000 7f3d1cb9b640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 0x7f3cfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.847+0000 7f3d1cb9b640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 0x7f3cfc06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c036000 tx=0x7f3d0c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:29.851+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d180abbf0 con 0x7f3d1815ea00 2024-04-16T12:55:30.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.036+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d1804fd90 con 0x7f3d1815ea00 2024-04-16T12:55:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.037+0000 7f3d157fa640 1 -- 172.21.15.18:0/1432387029 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f3d10059ff0 con 0x7f3d1815ea00 2024-04-16T12:55:30.039 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:30.039 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 msgr2=0x7f3cfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 0x7f3cfc06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c036000 tx=0x7f3d0c008030 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 msgr2=0x7f3d180cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007e60 tx=0x7f3d1000e4b0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 shutdown_connections 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3cfc06c8f0 0x7f3cfc06edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d1815ea00 0x7f3d180cdd30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d180b87b0 0x7f3d180cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 --2- 172.21.15.18:0/1432387029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d180b6190 0x7f3d18154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 >> 172.21.15.18:0/1432387029 conn(0x7f3d180d1190 msgr2=0x7f3d180cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 shutdown_connections 2024-04-16T12:55:30.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.039+0000 7f3d1db9d640 1 -- 172.21.15.18:0/1432387029 wait complete. 2024-04-16T12:55:30.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T12:55:30.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.159+0000 7f79397e1640 1 Processor -- start 2024-04-16T12:55:30.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.159+0000 7f79397e1640 1 -- start start 2024-04-16T12:55:30.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79397e1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f793409bc20 0x7f793409b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79397e1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79340d0690 0x7f79340d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79397e1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7934162300 con 0x7f793409aa10 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79397e1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f79340c9520 con 0x7f793409bc20 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79397e1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7934071d80 con 0x7f79340d0690 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79327fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f793409bc20 0x7f793409b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f7932ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f793409aa10 0x7f793409adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34566/0 (socket says 172.21.15.18:34566) 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f7932ffd640 1 -- 172.21.15.18:0/848766122 learned_addr learned my addr 172.21.15.18:0/848766122 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79337fe640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79340d0690 0x7f79340d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79327fc640 1 -- 172.21.15.18:0/848766122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79340d0690 msgr2=0x7f79340d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79327fc640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79340d0690 0x7f79340d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79327fc640 1 -- 172.21.15.18:0/848766122 >> v1:172.21.15.18:6789/0 conn(0x7f793409aa10 legacy=0x7f793409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f79327fc640 1 -- 172.21.15.18:0/848766122 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7934072060 con 0x7f793409bc20 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.160+0000 7f7931ffb640 1 -- 172.21.15.18:0/848766122 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339224933 0 0) 0x7f7934162300 con 0x7f793409aa10 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.161+0000 7f79327fc640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f793409bc20 0x7f793409b660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f791c0097a0 tx=0x7f791c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afcd402ad9435cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.161+0000 7f7931ffb640 1 -- 172.21.15.18:0/848766122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c035020 con 0x7f793409bc20 2024-04-16T12:55:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.161+0000 7f7931ffb640 1 -- 172.21.15.18:0/848766122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c031830 con 0x7f793409bc20 2024-04-16T12:55:30.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.161+0000 7f7931ffb640 1 -- 172.21.15.18:0/848766122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c031c00 con 0x7f793409bc20 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 -- 172.21.15.18:0/848766122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f793409bc20 msgr2=0x7f793409b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f793409bc20 0x7f793409b660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f791c0097a0 tx=0x7f791c02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 -- 172.21.15.18:0/848766122 shutdown_connections 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f79340d0690 0x7f79340d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 --2- 172.21.15.18:0/848766122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f793409bc20 0x7f793409b660 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 -- 172.21.15.18:0/848766122 >> 172.21.15.18:0/848766122 conn(0x7f79340d2600 msgr2=0x7f79340d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 -- 172.21.15.18:0/848766122 shutdown_connections 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.162+0000 7f79397e1640 1 -- 172.21.15.18:0/848766122 wait complete. 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.163+0000 7f79397e1640 1 Processor -- start 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.163+0000 7f79397e1640 1 -- start start 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f793409aa10 0x7f79340b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f793409bc20 0x7f79340b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f793406dba0 con 0x7f79340d0690 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f793406d8c0 con 0x7f793409aa10 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79397e1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7934071a30 con 0x7f793409bc20 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45444/0 (socket says 172.21.15.18:45444) 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 -- 172.21.15.18:0/1177694960 learned_addr learned my addr 172.21.15.18:0/1177694960 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f7932ffd640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f793409aa10 0x7f79340b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79327fc640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f793409bc20 0x7f79340b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 -- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f793409bc20 msgr2=0x7f79340b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f793409bc20 0x7f79340b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 -- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f793409aa10 msgr2=0x7f79340b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f793409aa10 0x7f79340b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 -- 172.21.15.18:0/1177694960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793415bb40 con 0x7f79340d0690 2024-04-16T12:55:30.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f79337fe640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f792c00d800 tx=0x7f792c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c00b6c0 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.164+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c019070 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.165+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79340b53a0 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.165+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c00bac0 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.165+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79340b5960 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.166+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793406eb00 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.166+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f792c00bc60 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.166+0000 7f792b7fe640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 0x7f791406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.166+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f792c08c180 con 0x7f79340d0690 2024-04-16T12:55:30.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.167+0000 7f7932ffd640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 0x7f791406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.167+0000 7f7932ffd640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 0x7f791406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79240012e0 tx=0x7f7924001630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.171+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f793406eb00 con 0x7f79340d0690 2024-04-16T12:55:30.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.395+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f79340d3360 con 0x7f79340d0690 2024-04-16T12:55:30.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.671+0000 7f792b7fe640 1 -- 172.21.15.18:0/1177694960 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f792c059c10 con 0x7f79340d0690 2024-04-16T12:55:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 msgr2=0x7f791406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 0x7f791406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79240012e0 tx=0x7f7924001630 comp rx=0 tx=0).stop 2024-04-16T12:55:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 msgr2=0x7f79341f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f792c00d800 tx=0x7f792c00dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 shutdown_connections 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f791406c920 0x7f791406ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79340d0690 0x7f79341f83d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f793409bc20 0x7f79340b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 --2- 172.21.15.18:0/1177694960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f793409aa10 0x7f79340b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 >> 172.21.15.18:0/1177694960 conn(0x7f79340d2600 msgr2=0x7f79340d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 shutdown_connections 2024-04-16T12:55:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.674+0000 7f79397e1640 1 -- 172.21.15.18:0/1177694960 wait complete. 2024-04-16T12:55:30.686 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-16T12:55:30.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T12:55:30.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.795+0000 7f52f989a640 1 Processor -- start 2024-04-16T12:55:30.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.795+0000 7f52f989a640 1 -- start start 2024-04-16T12:55:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f989a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f52f406c130 0x7f52f40d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f989a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f4163480 con 0x7f52f415ef70 2024-04-16T12:55:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f989a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f4163760 con 0x7f52f40b3a00 2024-04-16T12:55:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f989a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f52f415f350 con 0x7f52f406c130 2024-04-16T12:55:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f52f415ef70 0x7f52f406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34572/0 (socket says 172.21.15.18:34572) 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f2ffd640 1 -- 172.21.15.18:0/4229758156 learned_addr learned my addr 172.21.15.18:0/4229758156 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52ebfff640 1 --2- 172.21.15.18:0/4229758156 >> v2:172.21.15.104:3300/0 conn(0x7f52f406c130 0x7f52f40d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572176559 0 0) 0x7f52f4163480 con 0x7f52f415ef70 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.796+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e0003520 con 0x7f52f415ef70 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3509736949 0 0) 0x7f52e0003520 con 0x7f52f415ef70 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 >> v2:172.21.15.104:3300/0 conn(0x7f52f406c130 msgr2=0x7f52f40d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 --2- 172.21.15.18:0/4229758156 >> v2:172.21.15.104:3300/0 conn(0x7f52f406c130 0x7f52f40d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 >> v1:172.21.15.104:6789/0 conn(0x7f52f40b3a00 legacy=0x7f52f40d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f40d26c0 con 0x7f52f415ef70 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f52e4001670 con 0x7f52f415ef70 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 >> v1:172.21.15.18:6789/0 conn(0x7f52f415ef70 legacy=0x7f52f406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52f415f350 con 0x7f52e00051c0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f52e000c060 con 0x7f52e00039b0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f52e000c260 con 0x7f52e0004800 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f2ffd640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52ebfff640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 -- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e0004800 msgr2=0x7f52e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 -- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52e00039b0 msgr2=0x7f52e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.797+0000 7f52f37fe640 1 -- 172.21.15.18:0/4229758156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e0003520 con 0x7f52e00051c0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.798+0000 7f52f37fe640 1 -- 172.21.15.18:0/4229758156 reap_dead start 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.798+0000 7f52f37fe640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 0x7f52e000b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001e50 tx=0x7f52e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7824b139814d6a9a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.798+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec001a70 con 0x7f52e00051c0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.798+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec003bb0 con 0x7f52e00051c0 2024-04-16T12:55:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.798+0000 7f52f27fc640 1 -- 172.21.15.18:0/4229758156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0050d0 con 0x7f52e00051c0 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 -- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 msgr2=0x7f52e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 0x7f52e000b9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001e50 tx=0x7f52e0005830 comp rx=0 tx=0).stop 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 -- 172.21.15.18:0/4229758156 shutdown_connections 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 --2- 172.21.15.18:0/4229758156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 -- 172.21.15.18:0/4229758156 >> 172.21.15.18:0/4229758156 conn(0x7f52f40b69e0 msgr2=0x7f52f40d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 -- 172.21.15.18:0/4229758156 shutdown_connections 2024-04-16T12:55:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.799+0000 7f52f989a640 1 -- 172.21.15.18:0/4229758156 wait complete. 2024-04-16T12:55:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.800+0000 7f52f989a640 1 Processor -- start 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.800+0000 7f52f989a640 1 -- start start 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 0x7f52f4150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f415bf30 0x7f52f40c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40d2a30 con 0x7f52f4161c40 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40d2470 con 0x7f52f415bf30 2024-04-16T12:55:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f989a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f52f40b34b0 con 0x7f52e00051c0 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45466/0 (socket says 172.21.15.18:45466) 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 -- 172.21.15.18:0/2109284996 learned_addr learned my addr 172.21.15.18:0/2109284996 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52ebfff640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f415bf30 0x7f52f40c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f2ffd640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 0x7f52f4150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 -- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 msgr2=0x7f52f4150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 0x7f52f4150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 -- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f415bf30 msgr2=0x7f52f40c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f415bf30 0x7f52f40c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 -- 172.21.15.18:0/2109284996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f4160be0 con 0x7f52f4161c40 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f2ffd640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 0x7f52f4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f37fe640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001f70 tx=0x7f52ec0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.801+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007db0 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.802+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec006d60 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.802+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f4151110 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.802+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007230 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.802+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f4161160 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.803+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f40752b0 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.803+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52ec0073d0 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.804+0000 7f52f0ff9640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 0x7f52d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.804+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52ec0adf50 con 0x7f52f4161c40 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.804+0000 7f52f2ffd640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 0x7f52d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:30.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.804+0000 7f52f2ffd640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 0x7f52d406edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52e4007d50 tx=0x7f52e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:30.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:30.808+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52ec033030 con 0x7f52f4161c40 2024-04-16T12:55:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.031+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f52f40d00f0 con 0x7f52f4161c40 2024-04-16T12:55:31.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.673+0000 7f52f0ff9640 1 -- 172.21.15.18:0/2109284996 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f52ec07c040 con 0x7f52f4161c40 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 msgr2=0x7f52d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 0x7f52d406edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52e4007d50 tx=0x7f52e4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 msgr2=0x7f52f40cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001f70 tx=0x7f52ec0014a0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 shutdown_connections 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f52d406c8f0 0x7f52d406edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52f4161c40 0x7f52f40cd170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52f415bf30 0x7f52f40c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 --2- 172.21.15.18:0/2109284996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f52e00051c0 0x7f52f4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 >> 172.21.15.18:0/2109284996 conn(0x7f52f40b69e0 msgr2=0x7f52f415e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:31.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 shutdown_connections 2024-04-16T12:55:31.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.675+0000 7f52f989a640 1 -- 172.21.15.18:0/2109284996 wait complete. 2024-04-16T12:55:31.690 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T12:55:31.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:31.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.797+0000 7ff9ece47640 1 Processor -- start 2024-04-16T12:55:31.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.797+0000 7ff9ece47640 1 -- start start 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9ece47640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9e80b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9ece47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9e806c130 0x7ff9e806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9ece47640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e806c6c0 con 0x7ff9e806ce10 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9ece47640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e806d7b0 con 0x7ff9e806c130 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9ece47640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e806c9a0 con 0x7ff9e8162240 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff9e806ce10 0x7ff9e806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34582/0 (socket says 172.21.15.18:34582) 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9dffff640 1 -- 172.21.15.18:0/3843137574 learned_addr learned my addr 172.21.15.18:0/3843137574 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e6d9d640 1 --2- 172.21.15.18:0/3843137574 >> v2:172.21.15.104:3300/0 conn(0x7ff9e806c130 0x7ff9e806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9e80b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637817125 0 0) 0x7ff9e806c6c0 con 0x7ff9e806ce10 2024-04-16T12:55:31.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d4003520 con 0x7ff9e806ce10 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3452676641 0 0) 0x7ff9d4003520 con 0x7ff9e806ce10 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 msgr2=0x7ff9e80b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9e80b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 >> v2:172.21.15.104:3300/0 conn(0x7ff9e806c130 msgr2=0x7ff9e806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 --2- 172.21.15.18:0/3843137574 >> v2:172.21.15.104:3300/0 conn(0x7ff9e806c130 0x7ff9e806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80d2db0 con 0x7ff9e806ce10 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7ff9d0001670 con 0x7ff9e806ce10 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9e80b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.798+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 >> v1:172.21.15.18:6789/0 conn(0x7ff9e806ce10 legacy=0x7ff9e806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9d40039b0 0x7ff9d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9d4004800 0x7ff9d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e806c9a0 con 0x7ff9d40039b0 2024-04-16T12:55:31.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400b9c0 con 0x7ff9d4004800 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d400bb90 con 0x7ff9e8162240 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e6d9d640 1 --2- 172.21.15.18:0/3843137574 >> v2:172.21.15.104:3300/0 conn(0x7ff9e806c130 0x7ff9e806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9d40039b0 0x7ff9d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9dffff640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9d4004800 0x7ff9d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e6d9d640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 -- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 msgr2=0x7ff9d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9e8162240 0x7ff9d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 -- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9d4004800 msgr2=0x7ff9d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9d4004800 0x7ff9d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.799+0000 7ff9e659c640 1 -- 172.21.15.18:0/3843137574 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d4003520 con 0x7ff9d40039b0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9d40039b0 0x7ff9d4003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009c90 tx=0x7ff9d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fa1215fb8dd8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8039070 con 0x7ff9d40039b0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d802c8f0 con 0x7ff9d40039b0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9e5d9b640 1 -- 172.21.15.18:0/3843137574 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8009860 con 0x7ff9d40039b0 2024-04-16T12:55:31.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 -- 172.21.15.18:0/3843137574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9d40039b0 msgr2=0x7ff9d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3843137574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9d40039b0 0x7ff9d4003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009c90 tx=0x7ff9d4005830 comp rx=0 tx=0).stop 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9e6d9d640 1 -- 172.21.15.18:0/3843137574 reap_dead start 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 -- 172.21.15.18:0/3843137574 shutdown_connections 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 -- 172.21.15.18:0/3843137574 >> 172.21.15.18:0/3843137574 conn(0x7ff9e80d48b0 msgr2=0x7ff9e80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 -- 172.21.15.18:0/3843137574 shutdown_connections 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.800+0000 7ff9ece47640 1 -- 172.21.15.18:0/3843137574 wait complete. 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.802+0000 7ff9ece47640 1 Processor -- start 2024-04-16T12:55:31.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.802+0000 7ff9ece47640 1 -- start start 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.802+0000 7ff9ece47640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9d40039b0 0x7ff9e80ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.802+0000 7ff9ece47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.802+0000 7ff9ece47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 0x7ff9e80b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9ece47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b7c80 con 0x7ff9e80cdb20 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9ece47640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b7b00 con 0x7ff9e80ce4b0 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9ece47640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e80b7e00 con 0x7ff9d40039b0 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45480/0 (socket says 172.21.15.18:45480) 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 -- 172.21.15.18:0/3334765300 learned_addr learned my addr 172.21.15.18:0/3334765300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9d40039b0 0x7ff9e80ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9e6d9d640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 0x7ff9e80b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 -- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9d40039b0 msgr2=0x7ff9e80ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9d40039b0 0x7ff9e80ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 -- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 msgr2=0x7ff9e80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 0x7ff9e80b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 -- 172.21.15.18:0/3334765300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80ab2a0 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9e6d9d640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 0x7ff9e80b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9dffff640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0007310 tx=0x7ff9d00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000f8e0 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0018070 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e80ab580 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000fce0 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.803+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e80abb40 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.804+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e80752b0 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.805+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9d001d460 con 0x7ff9e80cdb20 2024-04-16T12:55:31.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.805+0000 7ff9deffd640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 0x7ff9c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:31.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.805+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff9d008be30 con 0x7ff9e80cdb20 2024-04-16T12:55:31.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.805+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 0x7ff9c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:31.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.806+0000 7ff9e659c640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 0x7ff9c806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8036000 tx=0x7ff9d8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:31.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:31.809+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9d0059f20 con 0x7ff9e80cdb20 2024-04-16T12:55:32.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.031+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e806dd30 con 0x7ff9e80cdb20 2024-04-16T12:55:32.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.031+0000 7ff9deffd640 1 -- 172.21.15.18:0/3334765300 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7ff9d0059820 con 0x7ff9e80cdb20 2024-04-16T12:55:32.033 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:32.033 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:32.033 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.033+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 msgr2=0x7ff9c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.033+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 0x7ff9c806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8036000 tx=0x7ff9d8030000 comp rx=0 tx=0).stop 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.033+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 msgr2=0x7ff9e80b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.033+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0007310 tx=0x7ff9d00077d0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 shutdown_connections 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff9c806c8f0 0x7ff9c806edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9e80ce4b0 0x7ff9e80b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9e80cdb20 0x7ff9e80b36c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 --2- 172.21.15.18:0/3334765300 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9d40039b0 0x7ff9e80ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 >> 172.21.15.18:0/3334765300 conn(0x7ff9e80d48b0 msgr2=0x7ff9e80d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 shutdown_connections 2024-04-16T12:55:32.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.034+0000 7ff9ece47640 1 -- 172.21.15.18:0/3334765300 wait complete. 2024-04-16T12:55:32.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.150+0000 7fa76cb8d640 1 Processor -- start 2024-04-16T12:55:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.150+0000 7fa76cb8d640 1 -- start start 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa76cb8d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa7680cf570 0x7fa768163120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa76cb8d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76806d990 con 0x7fa76815fcc0 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa76cb8d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76806d6b0 con 0x7fa76815e930 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa76cb8d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa7680d02c0 con 0x7fa7680cf570 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa766d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa7680cf570 0x7fa768163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa765d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa76815fcc0 0x7fa7680cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34588/0 (socket says 172.21.15.18:34588) 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.151+0000 7fa765d9b640 1 -- 172.21.15.18:0/1059403061 learned_addr learned my addr 172.21.15.18:0/1059403061 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.152+0000 7fa766d9d640 1 -- 172.21.15.18:0/1059403061 >> v1:172.21.15.104:6789/0 conn(0x7fa76815e930 legacy=0x7fa76806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.152+0000 7fa766d9d640 1 -- 172.21.15.18:0/1059403061 >> v1:172.21.15.18:6789/0 conn(0x7fa76815fcc0 legacy=0x7fa7680cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.152+0000 7fa766d9d640 1 -- 172.21.15.18:0/1059403061 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa768162640 con 0x7fa7680cf570 2024-04-16T12:55:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.152+0000 7fa76559a640 1 -- 172.21.15.18:0/1059403061 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529437439 0 0) 0x7fa76806d990 con 0x7fa76815fcc0 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.152+0000 7fa766d9d640 1 --2- 172.21.15.18:0/1059403061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa768163120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097a0 tx=0x7fa75802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319203220bd003f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76559a640 1 -- 172.21.15.18:0/1059403061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758034070 con 0x7fa7680cf570 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76559a640 1 -- 172.21.15.18:0/1059403061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758030610 con 0x7fa7680cf570 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76559a640 1 -- 172.21.15.18:0/1059403061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580309e0 con 0x7fa7680cf570 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 -- 172.21.15.18:0/1059403061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 msgr2=0x7fa768163120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/1059403061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa768163120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097a0 tx=0x7fa75802b960 comp rx=0 tx=0).stop 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 -- 172.21.15.18:0/1059403061 shutdown_connections 2024-04-16T12:55:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/1059403061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa768163120 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 -- 172.21.15.18:0/1059403061 >> 172.21.15.18:0/1059403061 conn(0x7fa7680b4230 msgr2=0x7fa7680b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 -- 172.21.15.18:0/1059403061 shutdown_connections 2024-04-16T12:55:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.153+0000 7fa76cb8d640 1 -- 172.21.15.18:0/1059403061 wait complete. 2024-04-16T12:55:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 Processor -- start 2024-04-16T12:55:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 -- start start 2024-04-16T12:55:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 0x7fa7680cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 0x7fa7680b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa76815ed10 con 0x7fa7680cf570 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa768162c90 con 0x7fa76815fcc0 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76cb8d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa7680cadd0 con 0x7fa76815e930 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.155+0000 7fa76659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45494/0 (socket says 172.21.15.18:45494) 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 -- 172.21.15.18:0/2092708805 learned_addr learned my addr 172.21.15.18:0/2092708805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa766d9d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 0x7fa7680b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa765d9b640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 0x7fa7680cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 -- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 msgr2=0x7fa7680cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 0x7fa7680cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 -- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 msgr2=0x7fa7680b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 0x7fa7680b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 -- 172.21.15.18:0/2092708805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7680cc600 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa765d9b640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 0x7fa7680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa766d9d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 0x7fa7680b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76659c640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c870 tx=0x7fa76000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760003b70 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760003d30 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76000aa90 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7680cb020 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.156+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7680cb5e0 con 0x7fa7680cf570 2024-04-16T12:55:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.157+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa768068a70 con 0x7fa7680cf570 2024-04-16T12:55:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.158+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa76000ac30 con 0x7fa7680cf570 2024-04-16T12:55:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.158+0000 7fa75effd640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 0x7fa74806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.158+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa76008be50 con 0x7fa7680cf570 2024-04-16T12:55:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.159+0000 7fa765d9b640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 0x7fa74806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.159+0000 7fa765d9b640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 0x7fa74806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7681f7b40 tx=0x7fa750009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.162+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7680cc600 con 0x7fa7680cf570 2024-04-16T12:55:32.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.348+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7680cfdf0 con 0x7fa7680cf570 2024-04-16T12:55:32.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.349+0000 7fa75effd640 1 -- 172.21.15.18:0/2092708805 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fa760059f40 con 0x7fa7680cf570 2024-04-16T12:55:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:32.351 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 msgr2=0x7fa74806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 0x7fa74806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7681f7b40 tx=0x7fa750009040 comp rx=0 tx=0).stop 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 msgr2=0x7fa7681563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c870 tx=0x7fa76000cd30 comp rx=0 tx=0).stop 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 shutdown_connections 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa74806c8f0 0x7fa74806edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa76815fcc0 0x7fa7680b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa76815e930 0x7fa7680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 --2- 172.21.15.18:0/2092708805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7680cf570 0x7fa7681563d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 >> 172.21.15.18:0/2092708805 conn(0x7fa7680b4230 msgr2=0x7fa768160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 shutdown_connections 2024-04-16T12:55:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.351+0000 7fa76cb8d640 1 -- 172.21.15.18:0/2092708805 wait complete. 2024-04-16T12:55:32.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T12:55:32.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:55:32.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.467+0000 7fcceed82640 1 Processor -- start 2024-04-16T12:55:32.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.467+0000 7fcceed82640 1 -- start start 2024-04-16T12:55:32.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcceed82640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 0x7fcce806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcceed82640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce80d01b0 con 0x7fcce80d3ed0 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcceed82640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce8163480 con 0x7fcce80b3a00 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcceed82640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcce815f350 con 0x7fcce815ef70 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcced31f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcce80d3ed0 0x7fcce80cfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34602/0 (socket says 172.21.15.18:34602) 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fcced31f640 1 -- 172.21.15.18:0/1374040790 learned_addr learned my addr 172.21.15.18:0/1374040790 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.468+0000 7fccecb1e640 1 --2- 172.21.15.18:0/1374040790 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 0x7fcce806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365292770 0 0) 0x7fcce80d01b0 con 0x7fcce80d3ed0 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccd4003520 con 0x7fcce80d3ed0 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228590084 0 0) 0x7fcce8163480 con 0x7fcce80b3a00 2024-04-16T12:55:32.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcce80d01b0 con 0x7fcce80b3a00 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fccecb1e640 1 -- 172.21.15.18:0/1374040790 >> v1:172.21.15.104:6789/0 conn(0x7fcce80b3a00 legacy=0x7fcce80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fccecb1e640 1 -- 172.21.15.18:0/1374040790 >> v1:172.21.15.18:6789/0 conn(0x7fcce80d3ed0 legacy=0x7fcce80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.469+0000 7fccecb1e640 1 -- 172.21.15.18:0/1374040790 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce8163760 con 0x7fcce815ef70 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fccecb1e640 1 --2- 172.21.15.18:0/1374040790 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 0x7fcce806ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcce00097d0 tx=0x7fcce002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbbac3d616404e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0035020 con 0x7fcce815ef70 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0031890 con 0x7fcce815ef70 2024-04-16T12:55:32.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcce77fe640 1 -- 172.21.15.18:0/1374040790 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0031c40 con 0x7fcce815ef70 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 -- 172.21.15.18:0/1374040790 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 msgr2=0x7fcce806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 --2- 172.21.15.18:0/1374040790 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 0x7fcce806ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcce00097d0 tx=0x7fcce002b930 comp rx=0 tx=0).stop 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 -- 172.21.15.18:0/1374040790 shutdown_connections 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 --2- 172.21.15.18:0/1374040790 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce815ef70 0x7fcce806ba20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 -- 172.21.15.18:0/1374040790 >> 172.21.15.18:0/1374040790 conn(0x7fcce80b69e0 msgr2=0x7fcce80d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 -- 172.21.15.18:0/1374040790 shutdown_connections 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.470+0000 7fcceed82640 1 -- 172.21.15.18:0/1374040790 wait complete. 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 Processor -- start 2024-04-16T12:55:32.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 -- start start 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce80d3ed0 0x7fcce815c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcce815ef70 0x7fcce81609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcce80d2a30 con 0x7fcce80b3a00 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcce80d2470 con 0x7fcce815ef70 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.472+0000 7fcceed82640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcce80d5160 con 0x7fcce80d3ed0 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45500/0 (socket says 172.21.15.18:45500) 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 -- 172.21.15.18:0/3275791854 learned_addr learned my addr 172.21.15.18:0/3275791854 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcce7fff640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce80d3ed0 0x7fcce815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcced31f640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcce815ef70 0x7fcce81609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 -- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce80d3ed0 msgr2=0x7fcce815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce80d3ed0 0x7fcce815c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 -- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcce815ef70 msgr2=0x7fcce81609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcce815ef70 0x7fcce81609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 -- 172.21.15.18:0/3275791854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce80ab940 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fccecb1e640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcce0000c00 tx=0x7fcce00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0035040 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0030d20 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce80abc20 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0006e10 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.473+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce8161ad0 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.474+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce80752b0 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.475+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcce0038020 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.475+0000 7fcce57fa640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 0x7fccc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.475+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcce00ae360 con 0x7fcce80b3a00 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.475+0000 7fcce7fff640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 0x7fccc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.476+0000 7fcce7fff640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 0x7fccc806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd0007fd0 tx=0x7fccd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.479+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcce002d040 con 0x7fcce80b3a00 2024-04-16T12:55:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.663+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcce80d1100 con 0x7fccc806c8f0 2024-04-16T12:55:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.672+0000 7fcce57fa640 1 -- 172.21.15.18:0/3275791854 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7fcce80d1100 con 0x7fccc806c8f0 2024-04-16T12:55:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 msgr2=0x7fccc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 0x7fccc806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd0007fd0 tx=0x7fccd0009040 comp rx=0 tx=0).stop 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 msgr2=0x7fcce80ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcce0000c00 tx=0x7fcce00046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 shutdown_connections 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fccc806c8f0 0x7fccc806edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcce815ef70 0x7fcce81609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcce80d3ed0 0x7fcce815c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 --2- 172.21.15.18:0/3275791854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80b3a00 0x7fcce80ab280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 >> 172.21.15.18:0/3275791854 conn(0x7fcce80b69e0 msgr2=0x7fcce80b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 shutdown_connections 2024-04-16T12:55:32.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.675+0000 7fcceed82640 1 -- 172.21.15.18:0/3275791854 wait complete. 2024-04-16T12:55:32.688 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-16T12:55:32.524571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231816,"kb_used_data":3176,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742904,"statfs":{"total":773094113280,"available":772856733696,"internally_reserved":0,"allocated":3252224,"data_stored":1985344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367479+0000","last_change":"2024-04-16T12:55:08.601362+0000","last_active":"2024-04-16T12:55:16.367479+0000","last_peered":"2024-04-16T12:55:16.367479+0000","last_clean":"2024-04-16T12:55:16.367479+0000","last_became_active":"2024-04-16T12:55:08.601067+0000","last_became_peered":"2024-04-16T12:55:08.601067+0000","last_unstale":"2024-04-16T12:55:16.367479+0000","last_undegraded":"2024-04-16T12:55:16.367479+0000","last_fullsized":"2024-04-16T12:55:16.367479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695218+0000","last_change":"2024-04-16T12:55:09.615816+0000","last_active":"2024-04-16T12:55:14.695218+0000","last_peered":"2024-04-16T12:55:14.695218+0000","last_clean":"2024-04-16T12:55:14.695218+0000","last_became_active":"2024-04-16T12:55:09.615467+0000","last_became_peered":"2024-04-16T12:55:09.615467+0000","last_unstale":"2024-04-16T12:55:14.695218+0000","last_undegraded":"2024-04-16T12:55:14.695218+0000","last_fullsized":"2024-04-16T12:55:14.695218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694776+0000","last_change":"2024-04-16T12:55:13.983588+0000","last_active":"2024-04-16T12:55:14.694776+0000","last_peered":"2024-04-16T12:55:14.694776+0000","last_clean":"2024-04-16T12:55:14.694776+0000","last_became_active":"2024-04-16T12:55:13.982853+0000","last_became_peered":"2024-04-16T12:55:13.982853+0000","last_unstale":"2024-04-16T12:55:14.694776+0000","last_undegraded":"2024-04-16T12:55:14.694776+0000","last_fullsized":"2024-04-16T12:55:14.694776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695423+0000","last_change":"2024-04-16T12:55:08.604046+0000","last_active":"2024-04-16T12:55:14.695423+0000","last_peered":"2024-04-16T12:55:14.695423+0000","last_clean":"2024-04-16T12:55:14.695423+0000","last_became_active":"2024-04-16T12:55:08.603686+0000","last_became_peered":"2024-04-16T12:55:08.603686+0000","last_unstale":"2024-04-16T12:55:14.695423+0000","last_undegraded":"2024-04-16T12:55:14.695423+0000","last_fullsized":"2024-04-16T12:55:14.695423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:09.977524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367376+0000","last_change":"2024-04-16T12:55:09.603388+0000","last_active":"2024-04-16T12:55:16.367376+0000","last_peered":"2024-04-16T12:55:16.367376+0000","last_clean":"2024-04-16T12:55:16.367376+0000","last_became_active":"2024-04-16T12:55:09.603127+0000","last_became_peered":"2024-04-16T12:55:09.603127+0000","last_unstale":"2024-04-16T12:55:16.367376+0000","last_undegraded":"2024-04-16T12:55:16.367376+0000","last_fullsized":"2024-04-16T12:55:16.367376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368880+0000","last_change":"2024-04-16T12:55:13.640798+0000","last_active":"2024-04-16T12:55:16.368880+0000","last_peered":"2024-04-16T12:55:16.368880+0000","last_clean":"2024-04-16T12:55:16.368880+0000","last_became_active":"2024-04-16T12:55:13.640396+0000","last_became_peered":"2024-04-16T12:55:13.640396+0000","last_unstale":"2024-04-16T12:55:16.368880+0000","last_undegraded":"2024-04-16T12:55:16.368880+0000","last_fullsized":"2024-04-16T12:55:16.368880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:30.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368816+0000","last_change":"2024-04-16T12:55:08.603812+0000","last_active":"2024-04-16T12:55:16.368816+0000","last_peered":"2024-04-16T12:55:16.368816+0000","last_clean":"2024-04-16T12:55:16.368816+0000","last_became_active":"2024-04-16T12:55:08.603521+0000","last_became_peered":"2024-04-16T12:55:08.603521+0000","last_unstale":"2024-04-16T12:55:16.368816+0000","last_undegraded":"2024-04-16T12:55:16.368816+0000","last_fullsized":"2024-04-16T12:55:16.368816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:29.707733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633822+0000","last_change":"2024-04-16T12:55:09.599628+0000","last_active":"2024-04-16T12:55:14.633822+0000","last_peered":"2024-04-16T12:55:14.633822+0000","last_clean":"2024-04-16T12:55:14.633822+0000","last_became_active":"2024-04-16T12:55:09.599322+0000","last_became_peered":"2024-04-16T12:55:09.599322+0000","last_unstale":"2024-04-16T12:55:14.633822+0000","last_undegraded":"2024-04-16T12:55:14.633822+0000","last_fullsized":"2024-04-16T12:55:14.633822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369484+0000","last_change":"2024-04-16T12:55:13.644781+0000","last_active":"2024-04-16T12:55:16.369484+0000","last_peered":"2024-04-16T12:55:16.369484+0000","last_clean":"2024-04-16T12:55:16.369484+0000","last_became_active":"2024-04-16T12:55:13.644284+0000","last_became_peered":"2024-04-16T12:55:13.644284+0000","last_unstale":"2024-04-16T12:55:16.369484+0000","last_undegraded":"2024-04-16T12:55:16.369484+0000","last_fullsized":"2024-04-16T12:55:16.369484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367966+0000","last_change":"2024-04-16T12:55:08.606441+0000","last_active":"2024-04-16T12:55:16.367966+0000","last_peered":"2024-04-16T12:55:16.367966+0000","last_clean":"2024-04-16T12:55:16.367966+0000","last_became_active":"2024-04-16T12:55:08.606162+0000","last_became_peered":"2024-04-16T12:55:08.606162+0000","last_unstale":"2024-04-16T12:55:16.367966+0000","last_undegraded":"2024-04-16T12:55:16.367966+0000","last_fullsized":"2024-04-16T12:55:16.367966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634055+0000","last_change":"2024-04-16T12:55:09.605124+0000","last_active":"2024-04-16T12:55:14.634055+0000","last_peered":"2024-04-16T12:55:14.634055+0000","last_clean":"2024-04-16T12:55:14.634055+0000","last_became_active":"2024-04-16T12:55:09.604225+0000","last_became_peered":"2024-04-16T12:55:09.604225+0000","last_unstale":"2024-04-16T12:55:14.634055+0000","last_undegraded":"2024-04-16T12:55:14.634055+0000","last_fullsized":"2024-04-16T12:55:14.634055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367712+0000","last_change":"2024-04-16T12:55:13.643994+0000","last_active":"2024-04-16T12:55:16.367712+0000","last_peered":"2024-04-16T12:55:16.367712+0000","last_clean":"2024-04-16T12:55:16.367712+0000","last_became_active":"2024-04-16T12:55:13.643551+0000","last_became_peered":"2024-04-16T12:55:13.643551+0000","last_unstale":"2024-04-16T12:55:16.367712+0000","last_undegraded":"2024-04-16T12:55:16.367712+0000","last_fullsized":"2024-04-16T12:55:16.367712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:07.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368044+0000","last_change":"2024-04-16T12:55:09.617118+0000","last_active":"2024-04-16T12:55:16.368044+0000","last_peered":"2024-04-16T12:55:16.368044+0000","last_clean":"2024-04-16T12:55:16.368044+0000","last_became_active":"2024-04-16T12:55:09.616808+0000","last_became_peered":"2024-04-16T12:55:09.616808+0000","last_unstale":"2024-04-16T12:55:16.368044+0000","last_undegraded":"2024-04-16T12:55:16.368044+0000","last_fullsized":"2024-04-16T12:55:16.368044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368824+0000","last_change":"2024-04-16T12:55:08.602196+0000","last_active":"2024-04-16T12:55:16.368824+0000","last_peered":"2024-04-16T12:55:16.368824+0000","last_clean":"2024-04-16T12:55:16.368824+0000","last_became_active":"2024-04-16T12:55:08.601896+0000","last_became_peered":"2024-04-16T12:55:08.601896+0000","last_unstale":"2024-04-16T12:55:16.368824+0000","last_undegraded":"2024-04-16T12:55:16.368824+0000","last_fullsized":"2024-04-16T12:55:16.368824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:44.870969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368907+0000","last_change":"2024-04-16T12:55:13.642915+0000","last_active":"2024-04-16T12:55:16.368907+0000","last_peered":"2024-04-16T12:55:16.368907+0000","last_clean":"2024-04-16T12:55:16.368907+0000","last_became_active":"2024-04-16T12:55:13.642404+0000","last_became_peered":"2024-04-16T12:55:13.642404+0000","last_unstale":"2024-04-16T12:55:16.368907+0000","last_undegraded":"2024-04-16T12:55:16.368907+0000","last_fullsized":"2024-04-16T12:55:16.368907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:12.774418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694920+0000","last_change":"2024-04-16T12:55:09.609312+0000","last_active":"2024-04-16T12:55:14.694920+0000","last_peered":"2024-04-16T12:55:14.694920+0000","last_clean":"2024-04-16T12:55:14.694920+0000","last_became_active":"2024-04-16T12:55:09.608972+0000","last_became_peered":"2024-04-16T12:55:09.608972+0000","last_unstale":"2024-04-16T12:55:14.694920+0000","last_undegraded":"2024-04-16T12:55:14.694920+0000","last_fullsized":"2024-04-16T12:55:14.694920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633101+0000","last_change":"2024-04-16T12:55:08.604374+0000","last_active":"2024-04-16T12:55:14.633101+0000","last_peered":"2024-04-16T12:55:14.633101+0000","last_clean":"2024-04-16T12:55:14.633101+0000","last_became_active":"2024-04-16T12:55:08.603813+0000","last_became_peered":"2024-04-16T12:55:08.603813+0000","last_unstale":"2024-04-16T12:55:14.633101+0000","last_undegraded":"2024-04-16T12:55:14.633101+0000","last_fullsized":"2024-04-16T12:55:14.633101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368459+0000","last_change":"2024-04-16T12:55:13.643708+0000","last_active":"2024-04-16T12:55:16.368459+0000","last_peered":"2024-04-16T12:55:16.368459+0000","last_clean":"2024-04-16T12:55:16.368459+0000","last_became_active":"2024-04-16T12:55:13.643298+0000","last_became_peered":"2024-04-16T12:55:13.643298+0000","last_unstale":"2024-04-16T12:55:16.368459+0000","last_undegraded":"2024-04-16T12:55:16.368459+0000","last_fullsized":"2024-04-16T12:55:16.368459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:46.270789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694839+0000","last_change":"2024-04-16T12:55:09.608016+0000","last_active":"2024-04-16T12:55:14.694839+0000","last_peered":"2024-04-16T12:55:14.694839+0000","last_clean":"2024-04-16T12:55:14.694839+0000","last_became_active":"2024-04-16T12:55:09.607708+0000","last_became_peered":"2024-04-16T12:55:09.607708+0000","last_unstale":"2024-04-16T12:55:14.694839+0000","last_undegraded":"2024-04-16T12:55:14.694839+0000","last_fullsized":"2024-04-16T12:55:14.694839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632908+0000","last_change":"2024-04-16T12:55:08.604999+0000","last_active":"2024-04-16T12:55:14.632908+0000","last_peered":"2024-04-16T12:55:14.632908+0000","last_clean":"2024-04-16T12:55:14.632908+0000","last_became_active":"2024-04-16T12:55:08.603479+0000","last_became_peered":"2024-04-16T12:55:08.603479+0000","last_unstale":"2024-04-16T12:55:14.632908+0000","last_undegraded":"2024-04-16T12:55:14.632908+0000","last_fullsized":"2024-04-16T12:55:14.632908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633683+0000","last_change":"2024-04-16T12:55:13.984277+0000","last_active":"2024-04-16T12:55:14.633683+0000","last_peered":"2024-04-16T12:55:14.633683+0000","last_clean":"2024-04-16T12:55:14.633683+0000","last_became_active":"2024-04-16T12:55:13.983911+0000","last_became_peered":"2024-04-16T12:55:13.983911+0000","last_unstale":"2024-04-16T12:55:14.633683+0000","last_undegraded":"2024-04-16T12:55:14.633683+0000","last_fullsized":"2024-04-16T12:55:14.633683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369689+0000","last_change":"2024-04-16T12:55:09.597064+0000","last_active":"2024-04-16T12:55:16.369689+0000","last_peered":"2024-04-16T12:55:16.369689+0000","last_clean":"2024-04-16T12:55:16.369689+0000","last_became_active":"2024-04-16T12:55:09.596531+0000","last_became_peered":"2024-04-16T12:55:09.596531+0000","last_unstale":"2024-04-16T12:55:16.369689+0000","last_undegraded":"2024-04-16T12:55:16.369689+0000","last_fullsized":"2024-04-16T12:55:16.369689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:41.388856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368817+0000","last_change":"2024-04-16T12:55:08.602603+0000","last_active":"2024-04-16T12:55:16.368817+0000","last_peered":"2024-04-16T12:55:16.368817+0000","last_clean":"2024-04-16T12:55:16.368817+0000","last_became_active":"2024-04-16T12:55:08.602324+0000","last_became_peered":"2024-04-16T12:55:08.602324+0000","last_unstale":"2024-04-16T12:55:16.368817+0000","last_undegraded":"2024-04-16T12:55:16.368817+0000","last_fullsized":"2024-04-16T12:55:16.368817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369344+0000","last_change":"2024-04-16T12:55:13.644854+0000","last_active":"2024-04-16T12:55:16.369344+0000","last_peered":"2024-04-16T12:55:16.369344+0000","last_clean":"2024-04-16T12:55:16.369344+0000","last_became_active":"2024-04-16T12:55:13.644347+0000","last_became_peered":"2024-04-16T12:55:13.644347+0000","last_unstale":"2024-04-16T12:55:16.369344+0000","last_undegraded":"2024-04-16T12:55:16.369344+0000","last_fullsized":"2024-04-16T12:55:16.369344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367451+0000","last_change":"2024-04-16T12:55:09.607401+0000","last_active":"2024-04-16T12:55:16.367451+0000","last_peered":"2024-04-16T12:55:16.367451+0000","last_clean":"2024-04-16T12:55:16.367451+0000","last_became_active":"2024-04-16T12:55:09.607073+0000","last_became_peered":"2024-04-16T12:55:09.607073+0000","last_unstale":"2024-04-16T12:55:16.367451+0000","last_undegraded":"2024-04-16T12:55:16.367451+0000","last_fullsized":"2024-04-16T12:55:16.367451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369471+0000","last_change":"2024-04-16T12:55:08.604773+0000","last_active":"2024-04-16T12:55:16.369471+0000","last_peered":"2024-04-16T12:55:16.369471+0000","last_clean":"2024-04-16T12:55:16.369471+0000","last_became_active":"2024-04-16T12:55:08.604275+0000","last_became_peered":"2024-04-16T12:55:08.604275+0000","last_unstale":"2024-04-16T12:55:16.369471+0000","last_undegraded":"2024-04-16T12:55:16.369471+0000","last_fullsized":"2024-04-16T12:55:16.369471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369565+0000","last_change":"2024-04-16T12:55:13.984733+0000","last_active":"2024-04-16T12:55:16.369565+0000","last_peered":"2024-04-16T12:55:16.369565+0000","last_clean":"2024-04-16T12:55:16.369565+0000","last_became_active":"2024-04-16T12:55:13.983970+0000","last_became_peered":"2024-04-16T12:55:13.983970+0000","last_unstale":"2024-04-16T12:55:16.369565+0000","last_undegraded":"2024-04-16T12:55:16.369565+0000","last_fullsized":"2024-04-16T12:55:16.369565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695546+0000","last_change":"2024-04-16T12:55:09.612698+0000","last_active":"2024-04-16T12:55:14.695546+0000","last_peered":"2024-04-16T12:55:14.695546+0000","last_clean":"2024-04-16T12:55:14.695546+0000","last_became_active":"2024-04-16T12:55:09.612401+0000","last_became_peered":"2024-04-16T12:55:09.612401+0000","last_unstale":"2024-04-16T12:55:14.695546+0000","last_undegraded":"2024-04-16T12:55:14.695546+0000","last_fullsized":"2024-04-16T12:55:14.695546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633691+0000","last_change":"2024-04-16T12:55:08.602265+0000","last_active":"2024-04-16T12:55:14.633691+0000","last_peered":"2024-04-16T12:55:14.633691+0000","last_clean":"2024-04-16T12:55:14.633691+0000","last_became_active":"2024-04-16T12:55:08.601969+0000","last_became_peered":"2024-04-16T12:55:08.601969+0000","last_unstale":"2024-04-16T12:55:14.633691+0000","last_undegraded":"2024-04-16T12:55:14.633691+0000","last_fullsized":"2024-04-16T12:55:14.633691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694594+0000","last_change":"2024-04-16T12:55:13.981871+0000","last_active":"2024-04-16T12:55:14.694594+0000","last_peered":"2024-04-16T12:55:14.694594+0000","last_clean":"2024-04-16T12:55:14.694594+0000","last_became_active":"2024-04-16T12:55:13.981491+0000","last_became_peered":"2024-04-16T12:55:13.981491+0000","last_unstale":"2024-04-16T12:55:14.694594+0000","last_undegraded":"2024-04-16T12:55:14.694594+0000","last_fullsized":"2024-04-16T12:55:14.694594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:58.777887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633569+0000","last_change":"2024-04-16T12:55:09.608036+0000","last_active":"2024-04-16T12:55:14.633569+0000","last_peered":"2024-04-16T12:55:14.633569+0000","last_clean":"2024-04-16T12:55:14.633569+0000","last_became_active":"2024-04-16T12:55:09.607748+0000","last_became_peered":"2024-04-16T12:55:09.607748+0000","last_unstale":"2024-04-16T12:55:14.633569+0000","last_undegraded":"2024-04-16T12:55:14.633569+0000","last_fullsized":"2024-04-16T12:55:14.633569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368966+0000","last_change":"2024-04-16T12:55:08.606601+0000","last_active":"2024-04-16T12:55:16.368966+0000","last_peered":"2024-04-16T12:55:16.368966+0000","last_clean":"2024-04-16T12:55:16.368966+0000","last_became_active":"2024-04-16T12:55:08.606293+0000","last_became_peered":"2024-04-16T12:55:08.606293+0000","last_unstale":"2024-04-16T12:55:16.368966+0000","last_undegraded":"2024-04-16T12:55:16.368966+0000","last_fullsized":"2024-04-16T12:55:16.368966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:02.120498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367098+0000","last_change":"2024-04-16T12:55:13.981993+0000","last_active":"2024-04-16T12:55:16.367098+0000","last_peered":"2024-04-16T12:55:16.367098+0000","last_clean":"2024-04-16T12:55:16.367098+0000","last_became_active":"2024-04-16T12:55:13.981384+0000","last_became_peered":"2024-04-16T12:55:13.981384+0000","last_unstale":"2024-04-16T12:55:16.367098+0000","last_undegraded":"2024-04-16T12:55:16.367098+0000","last_fullsized":"2024-04-16T12:55:16.367098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634120+0000","last_change":"2024-04-16T12:55:09.616638+0000","last_active":"2024-04-16T12:55:14.634120+0000","last_peered":"2024-04-16T12:55:14.634120+0000","last_clean":"2024-04-16T12:55:14.634120+0000","last_became_active":"2024-04-16T12:55:09.616217+0000","last_became_peered":"2024-04-16T12:55:09.616217+0000","last_unstale":"2024-04-16T12:55:14.634120+0000","last_undegraded":"2024-04-16T12:55:14.634120+0000","last_fullsized":"2024-04-16T12:55:14.634120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633590+0000","last_change":"2024-04-16T12:55:08.598000+0000","last_active":"2024-04-16T12:55:14.633590+0000","last_peered":"2024-04-16T12:55:14.633590+0000","last_clean":"2024-04-16T12:55:14.633590+0000","last_became_active":"2024-04-16T12:55:08.597703+0000","last_became_peered":"2024-04-16T12:55:08.597703+0000","last_unstale":"2024-04-16T12:55:14.633590+0000","last_undegraded":"2024-04-16T12:55:14.633590+0000","last_fullsized":"2024-04-16T12:55:14.633590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632782+0000","last_change":"2024-04-16T12:55:13.646625+0000","last_active":"2024-04-16T12:55:14.632782+0000","last_peered":"2024-04-16T12:55:14.632782+0000","last_clean":"2024-04-16T12:55:14.632782+0000","last_became_active":"2024-04-16T12:55:13.646260+0000","last_became_peered":"2024-04-16T12:55:13.646260+0000","last_unstale":"2024-04-16T12:55:14.632782+0000","last_undegraded":"2024-04-16T12:55:14.632782+0000","last_fullsized":"2024-04-16T12:55:14.632782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369676+0000","last_change":"2024-04-16T12:55:09.600934+0000","last_active":"2024-04-16T12:55:16.369676+0000","last_peered":"2024-04-16T12:55:16.369676+0000","last_clean":"2024-04-16T12:55:16.369676+0000","last_became_active":"2024-04-16T12:55:09.600399+0000","last_became_peered":"2024-04-16T12:55:09.600399+0000","last_unstale":"2024-04-16T12:55:16.369676+0000","last_undegraded":"2024-04-16T12:55:16.369676+0000","last_fullsized":"2024-04-16T12:55:16.369676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:43.700295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633893+0000","last_change":"2024-04-16T12:55:08.604212+0000","last_active":"2024-04-16T12:55:14.633893+0000","last_peered":"2024-04-16T12:55:14.633893+0000","last_clean":"2024-04-16T12:55:14.633893+0000","last_became_active":"2024-04-16T12:55:08.603941+0000","last_became_peered":"2024-04-16T12:55:08.603941+0000","last_unstale":"2024-04-16T12:55:14.633893+0000","last_undegraded":"2024-04-16T12:55:14.633893+0000","last_fullsized":"2024-04-16T12:55:14.633893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633482+0000","last_change":"2024-04-16T12:55:13.648783+0000","last_active":"2024-04-16T12:55:14.633482+0000","last_peered":"2024-04-16T12:55:14.633482+0000","last_clean":"2024-04-16T12:55:14.633482+0000","last_became_active":"2024-04-16T12:55:13.648394+0000","last_became_peered":"2024-04-16T12:55:13.648394+0000","last_unstale":"2024-04-16T12:55:14.633482+0000","last_undegraded":"2024-04-16T12:55:14.633482+0000","last_fullsized":"2024-04-16T12:55:14.633482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633151+0000","last_change":"2024-04-16T12:55:09.610829+0000","last_active":"2024-04-16T12:55:14.633151+0000","last_peered":"2024-04-16T12:55:14.633151+0000","last_clean":"2024-04-16T12:55:14.633151+0000","last_became_active":"2024-04-16T12:55:09.607200+0000","last_became_peered":"2024-04-16T12:55:09.607200+0000","last_unstale":"2024-04-16T12:55:14.633151+0000","last_undegraded":"2024-04-16T12:55:14.633151+0000","last_fullsized":"2024-04-16T12:55:14.633151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631656+0000","last_change":"2024-04-16T12:55:08.604218+0000","last_active":"2024-04-16T12:55:14.631656+0000","last_peered":"2024-04-16T12:55:14.631656+0000","last_clean":"2024-04-16T12:55:14.631656+0000","last_became_active":"2024-04-16T12:55:08.603910+0000","last_became_peered":"2024-04-16T12:55:08.603910+0000","last_unstale":"2024-04-16T12:55:14.631656+0000","last_undegraded":"2024-04-16T12:55:14.631656+0000","last_fullsized":"2024-04-16T12:55:14.631656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633704+0000","last_change":"2024-04-16T12:55:13.647025+0000","last_active":"2024-04-16T12:55:14.633704+0000","last_peered":"2024-04-16T12:55:14.633704+0000","last_clean":"2024-04-16T12:55:14.633704+0000","last_became_active":"2024-04-16T12:55:13.646214+0000","last_became_peered":"2024-04-16T12:55:13.646214+0000","last_unstale":"2024-04-16T12:55:14.633704+0000","last_undegraded":"2024-04-16T12:55:14.633704+0000","last_fullsized":"2024-04-16T12:55:14.633704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.366914+0000","last_change":"2024-04-16T12:55:09.600161+0000","last_active":"2024-04-16T12:55:16.366914+0000","last_peered":"2024-04-16T12:55:16.366914+0000","last_clean":"2024-04-16T12:55:16.366914+0000","last_became_active":"2024-04-16T12:55:09.599040+0000","last_became_peered":"2024-04-16T12:55:09.599040+0000","last_unstale":"2024-04-16T12:55:16.366914+0000","last_undegraded":"2024-04-16T12:55:16.366914+0000","last_fullsized":"2024-04-16T12:55:16.366914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:03.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369035+0000","last_change":"2024-04-16T12:55:08.602446+0000","last_active":"2024-04-16T12:55:16.369035+0000","last_peered":"2024-04-16T12:55:16.369035+0000","last_clean":"2024-04-16T12:55:16.369035+0000","last_became_active":"2024-04-16T12:55:08.602174+0000","last_became_peered":"2024-04-16T12:55:08.602174+0000","last_unstale":"2024-04-16T12:55:16.369035+0000","last_undegraded":"2024-04-16T12:55:16.369035+0000","last_fullsized":"2024-04-16T12:55:16.369035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367361+0000","last_change":"2024-04-16T12:55:13.981927+0000","last_active":"2024-04-16T12:55:16.367361+0000","last_peered":"2024-04-16T12:55:16.367361+0000","last_clean":"2024-04-16T12:55:16.367361+0000","last_became_active":"2024-04-16T12:55:13.981550+0000","last_became_peered":"2024-04-16T12:55:13.981550+0000","last_unstale":"2024-04-16T12:55:16.367361+0000","last_undegraded":"2024-04-16T12:55:16.367361+0000","last_fullsized":"2024-04-16T12:55:16.367361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:30.099478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694649+0000","last_change":"2024-04-16T12:55:09.615938+0000","last_active":"2024-04-16T12:55:14.694649+0000","last_peered":"2024-04-16T12:55:14.694649+0000","last_clean":"2024-04-16T12:55:14.694649+0000","last_became_active":"2024-04-16T12:55:09.615177+0000","last_became_peered":"2024-04-16T12:55:09.615177+0000","last_unstale":"2024-04-16T12:55:14.694649+0000","last_undegraded":"2024-04-16T12:55:14.694649+0000","last_fullsized":"2024-04-16T12:55:14.694649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633571+0000","last_change":"2024-04-16T12:55:08.599197+0000","last_active":"2024-04-16T12:55:14.633571+0000","last_peered":"2024-04-16T12:55:14.633571+0000","last_clean":"2024-04-16T12:55:14.633571+0000","last_became_active":"2024-04-16T12:55:08.598892+0000","last_became_peered":"2024-04-16T12:55:08.598892+0000","last_unstale":"2024-04-16T12:55:14.633571+0000","last_undegraded":"2024-04-16T12:55:14.633571+0000","last_fullsized":"2024-04-16T12:55:14.633571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368934+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:55:16.368934+0000","last_peered":"2024-04-16T12:55:16.368934+0000","last_clean":"2024-04-16T12:55:16.368934+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:55:16.368934+0000","last_undegraded":"2024-04-16T12:55:16.368934+0000","last_fullsized":"2024-04-16T12:55:16.368934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368883+0000","last_change":"2024-04-16T12:55:13.983109+0000","last_active":"2024-04-16T12:55:16.368883+0000","last_peered":"2024-04-16T12:55:16.368883+0000","last_clean":"2024-04-16T12:55:16.368883+0000","last_became_active":"2024-04-16T12:55:13.982685+0000","last_became_peered":"2024-04-16T12:55:13.982685+0000","last_unstale":"2024-04-16T12:55:16.368883+0000","last_undegraded":"2024-04-16T12:55:16.368883+0000","last_fullsized":"2024-04-16T12:55:16.368883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368489+0000","last_change":"2024-04-16T12:55:09.615455+0000","last_active":"2024-04-16T12:55:16.368489+0000","last_peered":"2024-04-16T12:55:16.368489+0000","last_clean":"2024-04-16T12:55:16.368489+0000","last_became_active":"2024-04-16T12:55:09.614879+0000","last_became_peered":"2024-04-16T12:55:09.614879+0000","last_unstale":"2024-04-16T12:55:16.368489+0000","last_undegraded":"2024-04-16T12:55:16.368489+0000","last_fullsized":"2024-04-16T12:55:16.368489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631857+0000","last_change":"2024-04-16T12:55:08.602417+0000","last_active":"2024-04-16T12:55:14.631857+0000","last_peered":"2024-04-16T12:55:14.631857+0000","last_clean":"2024-04-16T12:55:14.631857+0000","last_became_active":"2024-04-16T12:55:08.602116+0000","last_became_peered":"2024-04-16T12:55:08.602116+0000","last_unstale":"2024-04-16T12:55:14.631857+0000","last_undegraded":"2024-04-16T12:55:14.631857+0000","last_fullsized":"2024-04-16T12:55:14.631857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367931+0000","last_change":"2024-04-16T12:55:13.982825+0000","last_active":"2024-04-16T12:55:16.367931+0000","last_peered":"2024-04-16T12:55:16.367931+0000","last_clean":"2024-04-16T12:55:16.367931+0000","last_became_active":"2024-04-16T12:55:13.981463+0000","last_became_peered":"2024-04-16T12:55:13.981463+0000","last_unstale":"2024-04-16T12:55:16.367931+0000","last_undegraded":"2024-04-16T12:55:16.367931+0000","last_fullsized":"2024-04-16T12:55:16.367931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633956+0000","last_change":"2024-04-16T12:55:09.615888+0000","last_active":"2024-04-16T12:55:14.633956+0000","last_peered":"2024-04-16T12:55:14.633956+0000","last_clean":"2024-04-16T12:55:14.633956+0000","last_became_active":"2024-04-16T12:55:09.615272+0000","last_became_peered":"2024-04-16T12:55:09.615272+0000","last_unstale":"2024-04-16T12:55:14.633956+0000","last_undegraded":"2024-04-16T12:55:14.633956+0000","last_fullsized":"2024-04-16T12:55:14.633956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633411+0000","last_change":"2024-04-16T12:55:08.601281+0000","last_active":"2024-04-16T12:55:14.633411+0000","last_peered":"2024-04-16T12:55:14.633411+0000","last_clean":"2024-04-16T12:55:14.633411+0000","last_became_active":"2024-04-16T12:55:08.600899+0000","last_became_peered":"2024-04-16T12:55:08.600899+0000","last_unstale":"2024-04-16T12:55:14.633411+0000","last_undegraded":"2024-04-16T12:55:14.633411+0000","last_fullsized":"2024-04-16T12:55:14.633411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367245+0000","last_change":"2024-04-16T12:55:13.647207+0000","last_active":"2024-04-16T12:55:16.367245+0000","last_peered":"2024-04-16T12:55:16.367245+0000","last_clean":"2024-04-16T12:55:16.367245+0000","last_became_active":"2024-04-16T12:55:13.646389+0000","last_became_peered":"2024-04-16T12:55:13.646389+0000","last_unstale":"2024-04-16T12:55:16.367245+0000","last_undegraded":"2024-04-16T12:55:16.367245+0000","last_fullsized":"2024-04-16T12:55:16.367245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368504+0000","last_change":"2024-04-16T12:55:09.617673+0000","last_active":"2024-04-16T12:55:16.368504+0000","last_peered":"2024-04-16T12:55:16.368504+0000","last_clean":"2024-04-16T12:55:16.368504+0000","last_became_active":"2024-04-16T12:55:09.617168+0000","last_became_peered":"2024-04-16T12:55:09.617168+0000","last_unstale":"2024-04-16T12:55:16.368504+0000","last_undegraded":"2024-04-16T12:55:16.368504+0000","last_fullsized":"2024-04-16T12:55:16.368504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:18.474748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632028+0000","last_change":"2024-04-16T12:55:08.603386+0000","last_active":"2024-04-16T12:55:14.632028+0000","last_peered":"2024-04-16T12:55:14.632028+0000","last_clean":"2024-04-16T12:55:14.632028+0000","last_became_active":"2024-04-16T12:55:08.603101+0000","last_became_peered":"2024-04-16T12:55:08.603101+0000","last_unstale":"2024-04-16T12:55:14.632028+0000","last_undegraded":"2024-04-16T12:55:14.632028+0000","last_fullsized":"2024-04-16T12:55:14.632028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633245+0000","last_change":"2024-04-16T12:55:13.982430+0000","last_active":"2024-04-16T12:55:14.633245+0000","last_peered":"2024-04-16T12:55:14.633245+0000","last_clean":"2024-04-16T12:55:14.633245+0000","last_became_active":"2024-04-16T12:55:13.982015+0000","last_became_peered":"2024-04-16T12:55:13.982015+0000","last_unstale":"2024-04-16T12:55:14.633245+0000","last_undegraded":"2024-04-16T12:55:14.633245+0000","last_fullsized":"2024-04-16T12:55:14.633245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368249+0000","last_change":"2024-04-16T12:55:09.616105+0000","last_active":"2024-04-16T12:55:16.368249+0000","last_peered":"2024-04-16T12:55:16.368249+0000","last_clean":"2024-04-16T12:55:16.368249+0000","last_became_active":"2024-04-16T12:55:09.615832+0000","last_became_peered":"2024-04-16T12:55:09.615832+0000","last_unstale":"2024-04-16T12:55:16.368249+0000","last_undegraded":"2024-04-16T12:55:16.368249+0000","last_fullsized":"2024-04-16T12:55:16.368249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368416+0000","last_change":"2024-04-16T12:55:08.603695+0000","last_active":"2024-04-16T12:55:16.368416+0000","last_peered":"2024-04-16T12:55:16.368416+0000","last_clean":"2024-04-16T12:55:16.368416+0000","last_became_active":"2024-04-16T12:55:08.603425+0000","last_became_peered":"2024-04-16T12:55:08.603425+0000","last_unstale":"2024-04-16T12:55:16.368416+0000","last_undegraded":"2024-04-16T12:55:16.368416+0000","last_fullsized":"2024-04-16T12:55:16.368416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369160+0000","last_change":"2024-04-16T12:55:13.644589+0000","last_active":"2024-04-16T12:55:16.369160+0000","last_peered":"2024-04-16T12:55:16.369160+0000","last_clean":"2024-04-16T12:55:16.369160+0000","last_became_active":"2024-04-16T12:55:13.644211+0000","last_became_peered":"2024-04-16T12:55:13.644211+0000","last_unstale":"2024-04-16T12:55:16.369160+0000","last_undegraded":"2024-04-16T12:55:16.369160+0000","last_fullsized":"2024-04-16T12:55:16.369160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:38.226650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368542+0000","last_change":"2024-04-16T12:55:09.615275+0000","last_active":"2024-04-16T12:55:16.368542+0000","last_peered":"2024-04-16T12:55:16.368542+0000","last_clean":"2024-04-16T12:55:16.368542+0000","last_became_active":"2024-04-16T12:55:09.614772+0000","last_became_peered":"2024-04-16T12:55:09.614772+0000","last_unstale":"2024-04-16T12:55:16.368542+0000","last_undegraded":"2024-04-16T12:55:16.368542+0000","last_fullsized":"2024-04-16T12:55:16.368542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631386+0000","last_change":"2024-04-16T12:55:08.598164+0000","last_active":"2024-04-16T12:55:14.631386+0000","last_peered":"2024-04-16T12:55:14.631386+0000","last_clean":"2024-04-16T12:55:14.631386+0000","last_became_active":"2024-04-16T12:55:08.597846+0000","last_became_peered":"2024-04-16T12:55:08.597846+0000","last_unstale":"2024-04-16T12:55:14.631386+0000","last_undegraded":"2024-04-16T12:55:14.631386+0000","last_fullsized":"2024-04-16T12:55:14.631386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367265+0000","last_change":"2024-04-16T12:55:13.640511+0000","last_active":"2024-04-16T12:55:16.367265+0000","last_peered":"2024-04-16T12:55:16.367265+0000","last_clean":"2024-04-16T12:55:16.367265+0000","last_became_active":"2024-04-16T12:55:13.639882+0000","last_became_peered":"2024-04-16T12:55:13.639882+0000","last_unstale":"2024-04-16T12:55:16.367265+0000","last_undegraded":"2024-04-16T12:55:16.367265+0000","last_fullsized":"2024-04-16T12:55:16.367265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367597+0000","last_change":"2024-04-16T12:55:09.609001+0000","last_active":"2024-04-16T12:55:16.367597+0000","last_peered":"2024-04-16T12:55:16.367597+0000","last_clean":"2024-04-16T12:55:16.367597+0000","last_became_active":"2024-04-16T12:55:09.608734+0000","last_became_peered":"2024-04-16T12:55:09.608734+0000","last_unstale":"2024-04-16T12:55:16.367597+0000","last_undegraded":"2024-04-16T12:55:16.367597+0000","last_fullsized":"2024-04-16T12:55:16.367597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367952+0000","last_change":"2024-04-16T12:55:08.603335+0000","last_active":"2024-04-16T12:55:16.367952+0000","last_peered":"2024-04-16T12:55:16.367952+0000","last_clean":"2024-04-16T12:55:16.367952+0000","last_became_active":"2024-04-16T12:55:08.602990+0000","last_became_peered":"2024-04-16T12:55:08.602990+0000","last_unstale":"2024-04-16T12:55:16.367952+0000","last_undegraded":"2024-04-16T12:55:16.367952+0000","last_fullsized":"2024-04-16T12:55:16.367952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695518+0000","last_change":"2024-04-16T12:55:13.982306+0000","last_active":"2024-04-16T12:55:14.695518+0000","last_peered":"2024-04-16T12:55:14.695518+0000","last_clean":"2024-04-16T12:55:14.695518+0000","last_became_active":"2024-04-16T12:55:13.981930+0000","last_became_peered":"2024-04-16T12:55:13.981930+0000","last_unstale":"2024-04-16T12:55:14.695518+0000","last_undegraded":"2024-04-16T12:55:14.695518+0000","last_fullsized":"2024-04-16T12:55:14.695518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:08.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368720+0000","last_change":"2024-04-16T12:55:09.614600+0000","last_active":"2024-04-16T12:55:16.368720+0000","last_peered":"2024-04-16T12:55:16.368720+0000","last_clean":"2024-04-16T12:55:16.368720+0000","last_became_active":"2024-04-16T12:55:09.614325+0000","last_became_peered":"2024-04-16T12:55:09.614325+0000","last_unstale":"2024-04-16T12:55:16.368720+0000","last_undegraded":"2024-04-16T12:55:16.368720+0000","last_fullsized":"2024-04-16T12:55:16.368720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633785+0000","last_change":"2024-04-16T12:55:08.608010+0000","last_active":"2024-04-16T12:55:14.633785+0000","last_peered":"2024-04-16T12:55:14.633785+0000","last_clean":"2024-04-16T12:55:14.633785+0000","last_became_active":"2024-04-16T12:55:08.607694+0000","last_became_peered":"2024-04-16T12:55:08.607694+0000","last_unstale":"2024-04-16T12:55:14.633785+0000","last_undegraded":"2024-04-16T12:55:14.633785+0000","last_fullsized":"2024-04-16T12:55:14.633785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695213+0000","last_change":"2024-04-16T12:55:13.981780+0000","last_active":"2024-04-16T12:55:14.695213+0000","last_peered":"2024-04-16T12:55:14.695213+0000","last_clean":"2024-04-16T12:55:14.695213+0000","last_became_active":"2024-04-16T12:55:13.981378+0000","last_became_peered":"2024-04-16T12:55:13.981378+0000","last_unstale":"2024-04-16T12:55:14.695213+0000","last_undegraded":"2024-04-16T12:55:14.695213+0000","last_fullsized":"2024-04-16T12:55:14.695213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:34.588593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367107+0000","last_change":"2024-04-16T12:55:09.611318+0000","last_active":"2024-04-16T12:55:16.367107+0000","last_peered":"2024-04-16T12:55:16.367107+0000","last_clean":"2024-04-16T12:55:16.367107+0000","last_became_active":"2024-04-16T12:55:09.611021+0000","last_became_peered":"2024-04-16T12:55:09.611021+0000","last_unstale":"2024-04-16T12:55:16.367107+0000","last_undegraded":"2024-04-16T12:55:16.367107+0000","last_fullsized":"2024-04-16T12:55:16.367107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:22.528974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367349+0000","last_change":"2024-04-16T12:55:08.601634+0000","last_active":"2024-04-16T12:55:16.367349+0000","last_peered":"2024-04-16T12:55:16.367349+0000","last_clean":"2024-04-16T12:55:16.367349+0000","last_became_active":"2024-04-16T12:55:08.601348+0000","last_became_peered":"2024-04-16T12:55:08.601348+0000","last_unstale":"2024-04-16T12:55:16.367349+0000","last_undegraded":"2024-04-16T12:55:16.367349+0000","last_fullsized":"2024-04-16T12:55:16.367349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:39.045294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634061+0000","last_change":"2024-04-16T12:55:13.982101+0000","last_active":"2024-04-16T12:55:14.634061+0000","last_peered":"2024-04-16T12:55:14.634061+0000","last_clean":"2024-04-16T12:55:14.634061+0000","last_became_active":"2024-04-16T12:55:13.981652+0000","last_became_peered":"2024-04-16T12:55:13.981652+0000","last_unstale":"2024-04-16T12:55:14.634061+0000","last_undegraded":"2024-04-16T12:55:14.634061+0000","last_fullsized":"2024-04-16T12:55:14.634061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368372+0000","last_change":"2024-04-16T12:55:09.620820+0000","last_active":"2024-04-16T12:55:16.368372+0000","last_peered":"2024-04-16T12:55:16.368372+0000","last_clean":"2024-04-16T12:55:16.368372+0000","last_became_active":"2024-04-16T12:55:09.620534+0000","last_became_peered":"2024-04-16T12:55:09.620534+0000","last_unstale":"2024-04-16T12:55:16.368372+0000","last_undegraded":"2024-04-16T12:55:16.368372+0000","last_fullsized":"2024-04-16T12:55:16.368372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:19.234376+0000","last_change":"2024-04-16T12:55:08.605338+0000","last_active":"2024-04-16T12:55:19.234376+0000","last_peered":"2024-04-16T12:55:19.234376+0000","last_clean":"2024-04-16T12:55:19.234376+0000","last_became_active":"2024-04-16T12:55:08.604774+0000","last_became_peered":"2024-04-16T12:55:08.604774+0000","last_unstale":"2024-04-16T12:55:19.234376+0000","last_undegraded":"2024-04-16T12:55:19.234376+0000","last_fullsized":"2024-04-16T12:55:19.234376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633006+0000","last_change":"2024-04-16T12:55:13.646516+0000","last_active":"2024-04-16T12:55:14.633006+0000","last_peered":"2024-04-16T12:55:14.633006+0000","last_clean":"2024-04-16T12:55:14.633006+0000","last_became_active":"2024-04-16T12:55:13.645703+0000","last_became_peered":"2024-04-16T12:55:13.645703+0000","last_unstale":"2024-04-16T12:55:14.633006+0000","last_undegraded":"2024-04-16T12:55:14.633006+0000","last_fullsized":"2024-04-16T12:55:14.633006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369060+0000","last_change":"2024-04-16T12:55:09.606507+0000","last_active":"2024-04-16T12:55:16.369060+0000","last_peered":"2024-04-16T12:55:16.369060+0000","last_clean":"2024-04-16T12:55:16.369060+0000","last_became_active":"2024-04-16T12:55:09.606250+0000","last_became_peered":"2024-04-16T12:55:09.606250+0000","last_unstale":"2024-04-16T12:55:16.369060+0000","last_undegraded":"2024-04-16T12:55:16.369060+0000","last_fullsized":"2024-04-16T12:55:16.369060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633241+0000","last_change":"2024-04-16T12:55:08.609448+0000","last_active":"2024-04-16T12:55:14.633241+0000","last_peered":"2024-04-16T12:55:14.633241+0000","last_clean":"2024-04-16T12:55:14.633241+0000","last_became_active":"2024-04-16T12:55:08.609122+0000","last_became_peered":"2024-04-16T12:55:08.609122+0000","last_unstale":"2024-04-16T12:55:14.633241+0000","last_undegraded":"2024-04-16T12:55:14.633241+0000","last_fullsized":"2024-04-16T12:55:14.633241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369406+0000","last_change":"2024-04-16T12:55:13.644519+0000","last_active":"2024-04-16T12:55:16.369406+0000","last_peered":"2024-04-16T12:55:16.369406+0000","last_clean":"2024-04-16T12:55:16.369406+0000","last_became_active":"2024-04-16T12:55:13.644072+0000","last_became_peered":"2024-04-16T12:55:13.644072+0000","last_unstale":"2024-04-16T12:55:16.369406+0000","last_undegraded":"2024-04-16T12:55:16.369406+0000","last_fullsized":"2024-04-16T12:55:16.369406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367454+0000","last_change":"2024-04-16T12:55:09.599598+0000","last_active":"2024-04-16T12:55:16.367454+0000","last_peered":"2024-04-16T12:55:16.367454+0000","last_clean":"2024-04-16T12:55:16.367454+0000","last_became_active":"2024-04-16T12:55:09.599115+0000","last_became_peered":"2024-04-16T12:55:09.599115+0000","last_unstale":"2024-04-16T12:55:16.367454+0000","last_undegraded":"2024-04-16T12:55:16.367454+0000","last_fullsized":"2024-04-16T12:55:16.367454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633947+0000","last_change":"2024-04-16T12:55:08.607221+0000","last_active":"2024-04-16T12:55:14.633947+0000","last_peered":"2024-04-16T12:55:14.633947+0000","last_clean":"2024-04-16T12:55:14.633947+0000","last_became_active":"2024-04-16T12:55:08.606654+0000","last_became_peered":"2024-04-16T12:55:08.606654+0000","last_unstale":"2024-04-16T12:55:14.633947+0000","last_undegraded":"2024-04-16T12:55:14.633947+0000","last_fullsized":"2024-04-16T12:55:14.633947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694767+0000","last_change":"2024-04-16T12:55:13.638453+0000","last_active":"2024-04-16T12:55:14.694767+0000","last_peered":"2024-04-16T12:55:14.694767+0000","last_clean":"2024-04-16T12:55:14.694767+0000","last_became_active":"2024-04-16T12:55:13.637979+0000","last_became_peered":"2024-04-16T12:55:13.637979+0000","last_unstale":"2024-04-16T12:55:14.694767+0000","last_undegraded":"2024-04-16T12:55:14.694767+0000","last_fullsized":"2024-04-16T12:55:14.694767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:03:31.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633869+0000","last_change":"2024-04-16T12:55:09.608895+0000","last_active":"2024-04-16T12:55:14.633869+0000","last_peered":"2024-04-16T12:55:14.633869+0000","last_clean":"2024-04-16T12:55:14.633869+0000","last_became_active":"2024-04-16T12:55:09.608614+0000","last_became_peered":"2024-04-16T12:55:09.608614+0000","last_unstale":"2024-04-16T12:55:14.633869+0000","last_undegraded":"2024-04-16T12:55:14.633869+0000","last_fullsized":"2024-04-16T12:55:14.633869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369378+0000","last_change":"2024-04-16T12:55:08.609382+0000","last_active":"2024-04-16T12:55:16.369378+0000","last_peered":"2024-04-16T12:55:16.369378+0000","last_clean":"2024-04-16T12:55:16.369378+0000","last_became_active":"2024-04-16T12:55:08.609119+0000","last_became_peered":"2024-04-16T12:55:08.609119+0000","last_unstale":"2024-04-16T12:55:16.369378+0000","last_undegraded":"2024-04-16T12:55:16.369378+0000","last_fullsized":"2024-04-16T12:55:16.369378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694727+0000","last_change":"2024-04-16T12:55:13.983697+0000","last_active":"2024-04-16T12:55:14.694727+0000","last_peered":"2024-04-16T12:55:14.694727+0000","last_clean":"2024-04-16T12:55:14.694727+0000","last_became_active":"2024-04-16T12:55:13.983341+0000","last_became_peered":"2024-04-16T12:55:13.983341+0000","last_unstale":"2024-04-16T12:55:14.694727+0000","last_undegraded":"2024-04-16T12:55:14.694727+0000","last_fullsized":"2024-04-16T12:55:14.694727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367175+0000","last_change":"2024-04-16T12:55:13.982783+0000","last_active":"2024-04-16T12:55:16.367175+0000","last_peered":"2024-04-16T12:55:16.367175+0000","last_clean":"2024-04-16T12:55:16.367175+0000","last_became_active":"2024-04-16T12:55:13.982410+0000","last_became_peered":"2024-04-16T12:55:13.982410+0000","last_unstale":"2024-04-16T12:55:16.367175+0000","last_undegraded":"2024-04-16T12:55:16.367175+0000","last_fullsized":"2024-04-16T12:55:16.367175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632676+0000","last_change":"2024-04-16T12:55:09.613731+0000","last_active":"2024-04-16T12:55:14.632676+0000","last_peered":"2024-04-16T12:55:14.632676+0000","last_clean":"2024-04-16T12:55:14.632676+0000","last_became_active":"2024-04-16T12:55:09.613019+0000","last_became_peered":"2024-04-16T12:55:09.613019+0000","last_unstale":"2024-04-16T12:55:14.632676+0000","last_undegraded":"2024-04-16T12:55:14.632676+0000","last_fullsized":"2024-04-16T12:55:14.632676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633344+0000","last_change":"2024-04-16T12:55:08.607825+0000","last_active":"2024-04-16T12:55:14.633344+0000","last_peered":"2024-04-16T12:55:14.633344+0000","last_clean":"2024-04-16T12:55:14.633344+0000","last_became_active":"2024-04-16T12:55:08.607513+0000","last_became_peered":"2024-04-16T12:55:08.607513+0000","last_unstale":"2024-04-16T12:55:14.633344+0000","last_undegraded":"2024-04-16T12:55:14.633344+0000","last_fullsized":"2024-04-16T12:55:14.633344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369166+0000","last_change":"2024-04-16T12:55:13.648936+0000","last_active":"2024-04-16T12:55:16.369166+0000","last_peered":"2024-04-16T12:55:16.369166+0000","last_clean":"2024-04-16T12:55:16.369166+0000","last_became_active":"2024-04-16T12:55:13.648492+0000","last_became_peered":"2024-04-16T12:55:13.648492+0000","last_unstale":"2024-04-16T12:55:16.369166+0000","last_undegraded":"2024-04-16T12:55:16.369166+0000","last_fullsized":"2024-04-16T12:55:16.369166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694761+0000","last_change":"2024-04-16T12:55:09.613188+0000","last_active":"2024-04-16T12:55:14.694761+0000","last_peered":"2024-04-16T12:55:14.694761+0000","last_clean":"2024-04-16T12:55:14.694761+0000","last_became_active":"2024-04-16T12:55:09.612860+0000","last_became_peered":"2024-04-16T12:55:09.612860+0000","last_unstale":"2024-04-16T12:55:14.694761+0000","last_undegraded":"2024-04-16T12:55:14.694761+0000","last_fullsized":"2024-04-16T12:55:14.694761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694941+0000","last_change":"2024-04-16T12:55:08.603901+0000","last_active":"2024-04-16T12:55:14.694941+0000","last_peered":"2024-04-16T12:55:14.694941+0000","last_clean":"2024-04-16T12:55:14.694941+0000","last_became_active":"2024-04-16T12:55:08.603600+0000","last_became_peered":"2024-04-16T12:55:08.603600+0000","last_unstale":"2024-04-16T12:55:14.694941+0000","last_undegraded":"2024-04-16T12:55:14.694941+0000","last_fullsized":"2024-04-16T12:55:14.694941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368157+0000","last_change":"2024-04-16T12:55:08.603403+0000","last_active":"2024-04-16T12:55:16.368157+0000","last_peered":"2024-04-16T12:55:16.368157+0000","last_clean":"2024-04-16T12:55:16.368157+0000","last_became_active":"2024-04-16T12:55:08.603126+0000","last_became_peered":"2024-04-16T12:55:08.603126+0000","last_unstale":"2024-04-16T12:55:16.368157+0000","last_undegraded":"2024-04-16T12:55:16.368157+0000","last_fullsized":"2024-04-16T12:55:16.368157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367337+0000","last_change":"2024-04-16T12:55:09.599833+0000","last_active":"2024-04-16T12:55:16.367337+0000","last_peered":"2024-04-16T12:55:16.367337+0000","last_clean":"2024-04-16T12:55:16.367337+0000","last_became_active":"2024-04-16T12:55:09.599149+0000","last_became_peered":"2024-04-16T12:55:09.599149+0000","last_unstale":"2024-04-16T12:55:16.367337+0000","last_undegraded":"2024-04-16T12:55:16.367337+0000","last_fullsized":"2024-04-16T12:55:16.367337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631664+0000","last_change":"2024-04-16T12:55:13.650199+0000","last_active":"2024-04-16T12:55:14.631664+0000","last_peered":"2024-04-16T12:55:14.631664+0000","last_clean":"2024-04-16T12:55:14.631664+0000","last_became_active":"2024-04-16T12:55:13.649637+0000","last_became_peered":"2024-04-16T12:55:13.649637+0000","last_unstale":"2024-04-16T12:55:14.631664+0000","last_undegraded":"2024-04-16T12:55:14.631664+0000","last_fullsized":"2024-04-16T12:55:14.631664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:31.305753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694949+0000","last_change":"2024-04-16T12:55:08.606921+0000","last_active":"2024-04-16T12:55:14.694949+0000","last_peered":"2024-04-16T12:55:14.694949+0000","last_clean":"2024-04-16T12:55:14.694949+0000","last_became_active":"2024-04-16T12:55:08.606543+0000","last_became_peered":"2024-04-16T12:55:08.606543+0000","last_unstale":"2024-04-16T12:55:14.694949+0000","last_undegraded":"2024-04-16T12:55:14.694949+0000","last_fullsized":"2024-04-16T12:55:14.694949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367882+0000","last_change":"2024-04-16T12:55:09.607307+0000","last_active":"2024-04-16T12:55:16.367882+0000","last_peered":"2024-04-16T12:55:16.367882+0000","last_clean":"2024-04-16T12:55:16.367882+0000","last_became_active":"2024-04-16T12:55:09.607019+0000","last_became_peered":"2024-04-16T12:55:09.607019+0000","last_unstale":"2024-04-16T12:55:16.367882+0000","last_undegraded":"2024-04-16T12:55:16.367882+0000","last_fullsized":"2024-04-16T12:55:16.367882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:02.600497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695264+0000","last_change":"2024-04-16T12:55:13.641212+0000","last_active":"2024-04-16T12:55:14.695264+0000","last_peered":"2024-04-16T12:55:14.695264+0000","last_clean":"2024-04-16T12:55:14.695264+0000","last_became_active":"2024-04-16T12:55:13.640805+0000","last_became_peered":"2024-04-16T12:55:13.640805+0000","last_unstale":"2024-04-16T12:55:14.695264+0000","last_undegraded":"2024-04-16T12:55:14.695264+0000","last_fullsized":"2024-04-16T12:55:14.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:17.726629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367396+0000","last_change":"2024-04-16T12:55:09.609579+0000","last_active":"2024-04-16T12:55:16.367396+0000","last_peered":"2024-04-16T12:55:16.367396+0000","last_clean":"2024-04-16T12:55:16.367396+0000","last_became_active":"2024-04-16T12:55:09.609318+0000","last_became_peered":"2024-04-16T12:55:09.609318+0000","last_unstale":"2024-04-16T12:55:16.367396+0000","last_undegraded":"2024-04-16T12:55:16.367396+0000","last_fullsized":"2024-04-16T12:55:16.367396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631556+0000","last_change":"2024-04-16T12:55:09.603666+0000","last_active":"2024-04-16T12:55:14.631556+0000","last_peered":"2024-04-16T12:55:14.631556+0000","last_clean":"2024-04-16T12:55:14.631556+0000","last_became_active":"2024-04-16T12:55:09.603143+0000","last_became_peered":"2024-04-16T12:55:09.603143+0000","last_unstale":"2024-04-16T12:55:14.631556+0000","last_undegraded":"2024-04-16T12:55:14.631556+0000","last_fullsized":"2024-04-16T12:55:14.631556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633935+0000","last_change":"2024-04-16T12:55:09.617882+0000","last_active":"2024-04-16T12:55:14.633935+0000","last_peered":"2024-04-16T12:55:14.633935+0000","last_clean":"2024-04-16T12:55:14.633935+0000","last_became_active":"2024-04-16T12:55:09.616769+0000","last_became_peered":"2024-04-16T12:55:09.616769+0000","last_unstale":"2024-04-16T12:55:14.633935+0000","last_undegraded":"2024-04-16T12:55:14.633935+0000","last_fullsized":"2024-04-16T12:55:14.633935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367223+0000","last_change":"2024-04-16T12:55:09.602044+0000","last_active":"2024-04-16T12:55:16.367223+0000","last_peered":"2024-04-16T12:55:16.367223+0000","last_clean":"2024-04-16T12:55:16.367223+0000","last_became_active":"2024-04-16T12:55:09.601747+0000","last_became_peered":"2024-04-16T12:55:09.601747+0000","last_unstale":"2024-04-16T12:55:16.367223+0000","last_undegraded":"2024-04-16T12:55:16.367223+0000","last_fullsized":"2024-04-16T12:55:16.367223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695371+0000","last_change":"2024-04-16T12:55:09.600028+0000","last_active":"2024-04-16T12:55:14.695371+0000","last_peered":"2024-04-16T12:55:14.695371+0000","last_clean":"2024-04-16T12:55:14.695371+0000","last_became_active":"2024-04-16T12:55:09.599747+0000","last_became_peered":"2024-04-16T12:55:09.599747+0000","last_unstale":"2024-04-16T12:55:14.695371+0000","last_undegraded":"2024-04-16T12:55:14.695371+0000","last_fullsized":"2024-04-16T12:55:14.695371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633104+0000","last_change":"2024-04-16T12:55:09.612581+0000","last_active":"2024-04-16T12:55:14.633104+0000","last_peered":"2024-04-16T12:55:14.633104+0000","last_clean":"2024-04-16T12:55:14.633104+0000","last_became_active":"2024-04-16T12:55:09.612244+0000","last_became_peered":"2024-04-16T12:55:09.612244+0000","last_unstale":"2024-04-16T12:55:14.633104+0000","last_undegraded":"2024-04-16T12:55:14.633104+0000","last_fullsized":"2024-04-16T12:55:14.633104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369155+0000","last_change":"2024-04-16T12:55:09.611077+0000","last_active":"2024-04-16T12:55:16.369155+0000","last_peered":"2024-04-16T12:55:16.369155+0000","last_clean":"2024-04-16T12:55:16.369155+0000","last_became_active":"2024-04-16T12:55:09.610542+0000","last_became_peered":"2024-04-16T12:55:09.610542+0000","last_unstale":"2024-04-16T12:55:16.369155+0000","last_undegraded":"2024-04-16T12:55:16.369155+0000","last_fullsized":"2024-04-16T12:55:16.369155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695447+0000","last_change":"2024-04-16T12:55:09.600725+0000","last_active":"2024-04-16T12:55:14.695447+0000","last_peered":"2024-04-16T12:55:14.695447+0000","last_clean":"2024-04-16T12:55:14.695447+0000","last_became_active":"2024-04-16T12:55:09.600418+0000","last_became_peered":"2024-04-16T12:55:09.600418+0000","last_unstale":"2024-04-16T12:55:14.695447+0000","last_undegraded":"2024-04-16T12:55:14.695447+0000","last_fullsized":"2024-04-16T12:55:14.695447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633340+0000","last_change":"2024-04-16T12:55:09.616346+0000","last_active":"2024-04-16T12:55:14.633340+0000","last_peered":"2024-04-16T12:55:14.633340+0000","last_clean":"2024-04-16T12:55:14.633340+0000","last_became_active":"2024-04-16T12:55:09.615328+0000","last_became_peered":"2024-04-16T12:55:09.615328+0000","last_unstale":"2024-04-16T12:55:14.633340+0000","last_undegraded":"2024-04-16T12:55:14.633340+0000","last_fullsized":"2024-04-16T12:55:14.633340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694859+0000","last_change":"2024-04-16T12:55:09.597852+0000","last_active":"2024-04-16T12:55:14.694859+0000","last_peered":"2024-04-16T12:55:14.694859+0000","last_clean":"2024-04-16T12:55:14.694859+0000","last_became_active":"2024-04-16T12:55:09.597466+0000","last_became_peered":"2024-04-16T12:55:09.597466+0000","last_unstale":"2024-04-16T12:55:14.694859+0000","last_undegraded":"2024-04-16T12:55:14.694859+0000","last_fullsized":"2024-04-16T12:55:14.694859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633627+0000","last_change":"2024-04-16T12:55:09.610381+0000","last_active":"2024-04-16T12:55:14.633627+0000","last_peered":"2024-04-16T12:55:14.633627+0000","last_clean":"2024-04-16T12:55:14.633627+0000","last_became_active":"2024-04-16T12:55:09.610124+0000","last_became_peered":"2024-04-16T12:55:09.610124+0000","last_unstale":"2024-04-16T12:55:14.633627+0000","last_undegraded":"2024-04-16T12:55:14.633627+0000","last_fullsized":"2024-04-16T12:55:14.633627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367062+0000","last_change":"2024-04-16T12:55:09.616215+0000","last_active":"2024-04-16T12:55:16.367062+0000","last_peered":"2024-04-16T12:55:16.367062+0000","last_clean":"2024-04-16T12:55:16.367062+0000","last_became_active":"2024-04-16T12:55:09.615568+0000","last_became_peered":"2024-04-16T12:55:09.615568+0000","last_unstale":"2024-04-16T12:55:16.367062+0000","last_undegraded":"2024-04-16T12:55:16.367062+0000","last_fullsized":"2024-04-16T12:55:16.367062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369286+0000","last_change":"2024-04-16T12:55:09.617828+0000","last_active":"2024-04-16T12:55:16.369286+0000","last_peered":"2024-04-16T12:55:16.369286+0000","last_clean":"2024-04-16T12:55:16.369286+0000","last_became_active":"2024-04-16T12:55:09.617544+0000","last_became_peered":"2024-04-16T12:55:09.617544+0000","last_unstale":"2024-04-16T12:55:16.369286+0000","last_undegraded":"2024-04-16T12:55:16.369286+0000","last_fullsized":"2024-04-16T12:55:16.369286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368942+0000","last_change":"2024-04-16T12:55:09.612315+0000","last_active":"2024-04-16T12:55:16.368942+0000","last_peered":"2024-04-16T12:55:16.368942+0000","last_clean":"2024-04-16T12:55:16.368942+0000","last_became_active":"2024-04-16T12:55:09.612023+0000","last_became_peered":"2024-04-16T12:55:09.612023+0000","last_unstale":"2024-04-16T12:55:16.368942+0000","last_undegraded":"2024-04-16T12:55:16.368942+0000","last_fullsized":"2024-04-16T12:55:16.368942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:26.067302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632023+0000","last_change":"2024-04-16T12:55:09.609432+0000","last_active":"2024-04-16T12:55:14.632023+0000","last_peered":"2024-04-16T12:55:14.632023+0000","last_clean":"2024-04-16T12:55:14.632023+0000","last_became_active":"2024-04-16T12:55:09.609172+0000","last_became_peered":"2024-04-16T12:55:09.609172+0000","last_unstale":"2024-04-16T12:55:14.632023+0000","last_undegraded":"2024-04-16T12:55:14.632023+0000","last_fullsized":"2024-04-16T12:55:14.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634287+0000","last_change":"2024-04-16T12:55:09.607797+0000","last_active":"2024-04-16T12:55:14.634287+0000","last_peered":"2024-04-16T12:55:14.634287+0000","last_clean":"2024-04-16T12:55:14.634287+0000","last_became_active":"2024-04-16T12:55:09.607546+0000","last_became_peered":"2024-04-16T12:55:09.607546+0000","last_unstale":"2024-04-16T12:55:14.634287+0000","last_undegraded":"2024-04-16T12:55:14.634287+0000","last_fullsized":"2024-04-16T12:55:14.634287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633202+0000","last_change":"2024-04-16T12:55:09.613594+0000","last_active":"2024-04-16T12:55:14.633202+0000","last_peered":"2024-04-16T12:55:14.633202+0000","last_clean":"2024-04-16T12:55:14.633202+0000","last_became_active":"2024-04-16T12:55:09.613296+0000","last_became_peered":"2024-04-16T12:55:09.613296+0000","last_unstale":"2024-04-16T12:55:14.633202+0000","last_undegraded":"2024-04-16T12:55:14.633202+0000","last_fullsized":"2024-04-16T12:55:14.633202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632804+0000","last_change":"2024-04-16T12:55:09.613823+0000","last_active":"2024-04-16T12:55:14.632804+0000","last_peered":"2024-04-16T12:55:14.632804+0000","last_clean":"2024-04-16T12:55:14.632804+0000","last_became_active":"2024-04-16T12:55:09.613460+0000","last_became_peered":"2024-04-16T12:55:09.613460+0000","last_unstale":"2024-04-16T12:55:14.632804+0000","last_undegraded":"2024-04-16T12:55:14.632804+0000","last_fullsized":"2024-04-16T12:55:14.632804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367104+0000","last_change":"2024-04-16T12:55:09.605119+0000","last_active":"2024-04-16T12:55:16.367104+0000","last_peered":"2024-04-16T12:55:16.367104+0000","last_clean":"2024-04-16T12:55:16.367104+0000","last_became_active":"2024-04-16T12:55:09.604862+0000","last_became_peered":"2024-04-16T12:55:09.604862+0000","last_unstale":"2024-04-16T12:55:16.367104+0000","last_undegraded":"2024-04-16T12:55:16.367104+0000","last_fullsized":"2024-04-16T12:55:16.367104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:09.316326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694754+0000","last_change":"2024-04-16T12:55:09.605111+0000","last_active":"2024-04-16T12:55:14.694754+0000","last_peered":"2024-04-16T12:55:14.694754+0000","last_clean":"2024-04-16T12:55:14.694754+0000","last_became_active":"2024-04-16T12:55:09.604719+0000","last_became_peered":"2024-04-16T12:55:09.604719+0000","last_unstale":"2024-04-16T12:55:14.694754+0000","last_undegraded":"2024-04-16T12:55:14.694754+0000","last_fullsized":"2024-04-16T12:55:14.694754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368708+0000","last_change":"2024-04-16T12:55:09.608920+0000","last_active":"2024-04-16T12:55:16.368708+0000","last_peered":"2024-04-16T12:55:16.368708+0000","last_clean":"2024-04-16T12:55:16.368708+0000","last_became_active":"2024-04-16T12:55:09.608627+0000","last_became_peered":"2024-04-16T12:55:09.608627+0000","last_unstale":"2024-04-16T12:55:16.368708+0000","last_undegraded":"2024-04-16T12:55:16.368708+0000","last_fullsized":"2024-04-16T12:55:16.368708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369071+0000","last_change":"2024-04-16T12:55:09.619322+0000","last_active":"2024-04-16T12:55:16.369071+0000","last_peered":"2024-04-16T12:55:16.369071+0000","last_clean":"2024-04-16T12:55:16.369071+0000","last_became_active":"2024-04-16T12:55:09.619043+0000","last_became_peered":"2024-04-16T12:55:09.619043+0000","last_unstale":"2024-04-16T12:55:16.369071+0000","last_undegraded":"2024-04-16T12:55:16.369071+0000","last_fullsized":"2024-04-16T12:55:16.369071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369041+0000","last_change":"2024-04-16T12:55:09.618675+0000","last_active":"2024-04-16T12:55:16.369041+0000","last_peered":"2024-04-16T12:55:16.369041+0000","last_clean":"2024-04-16T12:55:16.369041+0000","last_became_active":"2024-04-16T12:55:09.618346+0000","last_became_peered":"2024-04-16T12:55:09.618346+0000","last_unstale":"2024-04-16T12:55:16.369041+0000","last_undegraded":"2024-04-16T12:55:16.369041+0000","last_fullsized":"2024-04-16T12:55:16.369041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368488+0000","last_change":"2024-04-16T12:55:09.616435+0000","last_active":"2024-04-16T12:55:16.368488+0000","last_peered":"2024-04-16T12:55:16.368488+0000","last_clean":"2024-04-16T12:55:16.368488+0000","last_became_active":"2024-04-16T12:55:09.616054+0000","last_became_peered":"2024-04-16T12:55:09.616054+0000","last_unstale":"2024-04-16T12:55:16.368488+0000","last_undegraded":"2024-04-16T12:55:16.368488+0000","last_fullsized":"2024-04-16T12:55:16.368488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694651+0000","last_change":"2024-04-16T12:55:09.616193+0000","last_active":"2024-04-16T12:55:14.694651+0000","last_peered":"2024-04-16T12:55:14.694651+0000","last_clean":"2024-04-16T12:55:14.694651+0000","last_became_active":"2024-04-16T12:55:09.615114+0000","last_became_peered":"2024-04-16T12:55:09.615114+0000","last_unstale":"2024-04-16T12:55:14.694651+0000","last_undegraded":"2024-04-16T12:55:14.694651+0000","last_fullsized":"2024-04-16T12:55:14.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368221+0000","last_change":"2024-04-16T12:55:09.612626+0000","last_active":"2024-04-16T12:55:16.368221+0000","last_peered":"2024-04-16T12:55:16.368221+0000","last_clean":"2024-04-16T12:55:16.368221+0000","last_became_active":"2024-04-16T12:55:09.612338+0000","last_became_peered":"2024-04-16T12:55:09.612338+0000","last_unstale":"2024-04-16T12:55:16.368221+0000","last_undegraded":"2024-04-16T12:55:16.368221+0000","last_fullsized":"2024-04-16T12:55:16.368221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633547+0000","last_change":"2024-04-16T12:55:09.613314+0000","last_active":"2024-04-16T12:55:14.633547+0000","last_peered":"2024-04-16T12:55:14.633547+0000","last_clean":"2024-04-16T12:55:14.633547+0000","last_became_active":"2024-04-16T12:55:09.613047+0000","last_became_peered":"2024-04-16T12:55:09.613047+0000","last_unstale":"2024-04-16T12:55:14.633547+0000","last_undegraded":"2024-04-16T12:55:14.633547+0000","last_fullsized":"2024-04-16T12:55:14.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368254+0000","last_change":"2024-04-16T12:55:09.612821+0000","last_active":"2024-04-16T12:55:16.368254+0000","last_peered":"2024-04-16T12:55:16.368254+0000","last_clean":"2024-04-16T12:55:16.368254+0000","last_became_active":"2024-04-16T12:55:09.612537+0000","last_became_peered":"2024-04-16T12:55:09.612537+0000","last_unstale":"2024-04-16T12:55:16.368254+0000","last_undegraded":"2024-04-16T12:55:16.368254+0000","last_fullsized":"2024-04-16T12:55:16.368254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633793+0000","last_change":"2024-04-16T12:55:09.616023+0000","last_active":"2024-04-16T12:55:14.633793+0000","last_peered":"2024-04-16T12:55:14.633793+0000","last_clean":"2024-04-16T12:55:14.633793+0000","last_became_active":"2024-04-16T12:55:09.615631+0000","last_became_peered":"2024-04-16T12:55:09.615631+0000","last_unstale":"2024-04-16T12:55:14.633793+0000","last_undegraded":"2024-04-16T12:55:14.633793+0000","last_fullsized":"2024-04-16T12:55:14.633793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367139+0000","last_change":"2024-04-16T12:55:09.595574+0000","last_active":"2024-04-16T12:55:16.367139+0000","last_peered":"2024-04-16T12:55:16.367139+0000","last_clean":"2024-04-16T12:55:16.367139+0000","last_became_active":"2024-04-16T12:55:09.595237+0000","last_became_peered":"2024-04-16T12:55:09.595237+0000","last_unstale":"2024-04-16T12:55:16.367139+0000","last_undegraded":"2024-04-16T12:55:16.367139+0000","last_fullsized":"2024-04-16T12:55:16.367139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633687+0000","last_change":"2024-04-16T12:55:09.609132+0000","last_active":"2024-04-16T12:55:14.633687+0000","last_peered":"2024-04-16T12:55:14.633687+0000","last_clean":"2024-04-16T12:55:14.633687+0000","last_became_active":"2024-04-16T12:55:09.608733+0000","last_became_peered":"2024-04-16T12:55:09.608733+0000","last_unstale":"2024-04-16T12:55:14.633687+0000","last_undegraded":"2024-04-16T12:55:14.633687+0000","last_fullsized":"2024-04-16T12:55:14.633687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368365+0000","last_change":"2024-04-16T12:55:09.617426+0000","last_active":"2024-04-16T12:55:16.368365+0000","last_peered":"2024-04-16T12:55:16.368365+0000","last_clean":"2024-04-16T12:55:16.368365+0000","last_became_active":"2024-04-16T12:55:09.616828+0000","last_became_peered":"2024-04-16T12:55:09.616828+0000","last_unstale":"2024-04-16T12:55:16.368365+0000","last_undegraded":"2024-04-16T12:55:16.368365+0000","last_fullsized":"2024-04-16T12:55:16.368365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:01.823408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":690366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":99416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":690422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:55:32.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:55:32.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.832+0000 7f6e0eb3d640 1 Processor -- start 2024-04-16T12:55:32.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.832+0000 7f6e0eb3d640 1 -- start start 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0eb3d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6e0806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0eb3d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6e080d3ed0 0x7f6e0806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0eb3d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e08163480 con 0x7f6e080b3a00 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0eb3d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0815f350 con 0x7f6e080d3ed0 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0eb3d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6e080d2470 con 0x7f6e0815ef70 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e07fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6e080b3a00 0x7f6e080cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34606/0 (socket says 172.21.15.18:34606) 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e07fff640 1 -- 172.21.15.18:0/3647100918 learned_addr learned my addr 172.21.15.18:0/3647100918 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0c8d9640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6e0806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e0d0da640 1 --2- 172.21.15.18:0/3647100918 >> v2:172.21.15.104:3300/0 conn(0x7f6e080d3ed0 0x7f6e0806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535737837 0 0) 0x7f6e08163480 con 0x7f6e080b3a00 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df8003520 con 0x7f6e080b3a00 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2233075417 0 0) 0x7f6df8003520 con 0x7f6e080b3a00 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 msgr2=0x7f6e0806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6e0806ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 >> v2:172.21.15.104:3300/0 conn(0x7f6e080d3ed0 msgr2=0x7f6e0806bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 --2- 172.21.15.18:0/3647100918 >> v2:172.21.15.104:3300/0 conn(0x7f6e080d3ed0 0x7f6e0806bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e08163760 con 0x7f6e080b3a00 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f6df4001670 con 0x7f6e080b3a00 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 >> v1:172.21.15.18:6789/0 conn(0x7f6e080b3a00 legacy=0x7f6e080cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.833+0000 7f6e077fe640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6df80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e077fe640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df8003f30 0x7f6df8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e077fe640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0815f350 con 0x7f6df8003f30 2024-04-16T12:55:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e080d2470 con 0x7f6df8004d40 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6df800b9c0 con 0x7f6e0815ef70 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df8003f30 0x7f6df8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e0c8d9640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6df80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e0d0da640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 -- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 msgr2=0x7f6df80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e0815ef70 0x7f6df80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 -- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6df8004d40 msgr2=0x7f6df80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6df8004d40 0x7f6df80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.834+0000 7f6e07fff640 1 -- 172.21.15.18:0/3647100918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df8003520 con 0x7f6df8003f30 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e07fff640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df8003f30 0x7f6df8004800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c210 tx=0x7f6df8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5a8ff927dc1580 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4007d50 con 0x7f6df8003f30 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df4030070 con 0x7f6df8003f30 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e077fe640 1 -- 172.21.15.18:0/3647100918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df402cdb0 con 0x7f6df8003f30 2024-04-16T12:55:32.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/3647100918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df8003f30 msgr2=0x7f6df8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/3647100918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df8003f30 0x7f6df8004800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c210 tx=0x7f6df8005830 comp rx=0 tx=0).stop 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0d0da640 1 -- 172.21.15.18:0/3647100918 reap_dead start 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/3647100918 shutdown_connections 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/3647100918 >> 172.21.15.18:0/3647100918 conn(0x7f6e080b69e0 msgr2=0x7f6e080d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/3647100918 shutdown_connections 2024-04-16T12:55:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.835+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/3647100918 wait complete. 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 Processor -- start 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 -- start start 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6df8003f30 0x7f6e080cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e081f8780 0x7f6e081f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e080d5160 con 0x7f6e08162770 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e080d2a30 con 0x7f6e081f8780 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.837+0000 7f6e0eb3d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6e080b34b0 con 0x7f6df8003f30 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45532/0 (socket says 172.21.15.18:45532) 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 -- 172.21.15.18:0/2578634305 learned_addr learned my addr 172.21.15.18:0/2578634305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e0d0da640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e081f8780 0x7f6e081f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e0c8d9640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6df8003f30 0x7f6e080cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 -- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6df8003f30 msgr2=0x7f6e080cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6df8003f30 0x7f6e080cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 -- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e081f8780 msgr2=0x7f6e081f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e081f8780 0x7f6e081f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 -- 172.21.15.18:0/2578634305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e081503b0 con 0x7f6e08162770 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e07fff640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c330 tx=0x7f6df4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4001c90 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df4004bf0 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0815f570 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4007070 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.838+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0815fb30 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.839+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e080752b0 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.840+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6df4047020 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.840+0000 7f6e057fa640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 0x7f6dec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.840+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6df40acf00 con 0x7f6e08162770 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.840+0000 7f6e0c8d9640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 0x7f6dec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.841+0000 7f6e0c8d9640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 0x7f6dec06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009ae0 tx=0x7f6dfc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:32.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:32.844+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6df407b140 con 0x7f6e08162770 2024-04-16T12:55:33.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.025+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e080d1100 con 0x7f6dec06c920 2024-04-16T12:55:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.034+0000 7f6e057fa640 1 -- 172.21.15.18:0/2578634305 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f6e080d1100 con 0x7f6dec06c920 2024-04-16T12:55:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:55:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 msgr2=0x7f6dec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 0x7f6dec06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009ae0 tx=0x7f6dfc009190 comp rx=0 tx=0).stop 2024-04-16T12:55:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 msgr2=0x7f6e080c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c330 tx=0x7f6df4001a40 comp rx=0 tx=0).stop 2024-04-16T12:55:33.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 shutdown_connections 2024-04-16T12:55:33.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6dec06c920 0x7f6dec06ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e081f8780 0x7f6e081f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e08162770 0x7f6e080c9e60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 --2- 172.21.15.18:0/2578634305 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6df8003f30 0x7f6e080cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 >> 172.21.15.18:0/2578634305 conn(0x7f6e080b69e0 msgr2=0x7f6e080b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 shutdown_connections 2024-04-16T12:55:33.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.037+0000 7f6e0eb3d640 1 -- 172.21.15.18:0/2578634305 wait complete. 2024-04-16T12:55:33.051 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-16T12:55:32.524571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231816,"kb_used_data":3176,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742904,"statfs":{"total":773094113280,"available":772856733696,"internally_reserved":0,"allocated":3252224,"data_stored":1985344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367479+0000","last_change":"2024-04-16T12:55:08.601362+0000","last_active":"2024-04-16T12:55:16.367479+0000","last_peered":"2024-04-16T12:55:16.367479+0000","last_clean":"2024-04-16T12:55:16.367479+0000","last_became_active":"2024-04-16T12:55:08.601067+0000","last_became_peered":"2024-04-16T12:55:08.601067+0000","last_unstale":"2024-04-16T12:55:16.367479+0000","last_undegraded":"2024-04-16T12:55:16.367479+0000","last_fullsized":"2024-04-16T12:55:16.367479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695218+0000","last_change":"2024-04-16T12:55:09.615816+0000","last_active":"2024-04-16T12:55:14.695218+0000","last_peered":"2024-04-16T12:55:14.695218+0000","last_clean":"2024-04-16T12:55:14.695218+0000","last_became_active":"2024-04-16T12:55:09.615467+0000","last_became_peered":"2024-04-16T12:55:09.615467+0000","last_unstale":"2024-04-16T12:55:14.695218+0000","last_undegraded":"2024-04-16T12:55:14.695218+0000","last_fullsized":"2024-04-16T12:55:14.695218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694776+0000","last_change":"2024-04-16T12:55:13.983588+0000","last_active":"2024-04-16T12:55:14.694776+0000","last_peered":"2024-04-16T12:55:14.694776+0000","last_clean":"2024-04-16T12:55:14.694776+0000","last_became_active":"2024-04-16T12:55:13.982853+0000","last_became_peered":"2024-04-16T12:55:13.982853+0000","last_unstale":"2024-04-16T12:55:14.694776+0000","last_undegraded":"2024-04-16T12:55:14.694776+0000","last_fullsized":"2024-04-16T12:55:14.694776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695423+0000","last_change":"2024-04-16T12:55:08.604046+0000","last_active":"2024-04-16T12:55:14.695423+0000","last_peered":"2024-04-16T12:55:14.695423+0000","last_clean":"2024-04-16T12:55:14.695423+0000","last_became_active":"2024-04-16T12:55:08.603686+0000","last_became_peered":"2024-04-16T12:55:08.603686+0000","last_unstale":"2024-04-16T12:55:14.695423+0000","last_undegraded":"2024-04-16T12:55:14.695423+0000","last_fullsized":"2024-04-16T12:55:14.695423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:09.977524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367376+0000","last_change":"2024-04-16T12:55:09.603388+0000","last_active":"2024-04-16T12:55:16.367376+0000","last_peered":"2024-04-16T12:55:16.367376+0000","last_clean":"2024-04-16T12:55:16.367376+0000","last_became_active":"2024-04-16T12:55:09.603127+0000","last_became_peered":"2024-04-16T12:55:09.603127+0000","last_unstale":"2024-04-16T12:55:16.367376+0000","last_undegraded":"2024-04-16T12:55:16.367376+0000","last_fullsized":"2024-04-16T12:55:16.367376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368880+0000","last_change":"2024-04-16T12:55:13.640798+0000","last_active":"2024-04-16T12:55:16.368880+0000","last_peered":"2024-04-16T12:55:16.368880+0000","last_clean":"2024-04-16T12:55:16.368880+0000","last_became_active":"2024-04-16T12:55:13.640396+0000","last_became_peered":"2024-04-16T12:55:13.640396+0000","last_unstale":"2024-04-16T12:55:16.368880+0000","last_undegraded":"2024-04-16T12:55:16.368880+0000","last_fullsized":"2024-04-16T12:55:16.368880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:30.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368816+0000","last_change":"2024-04-16T12:55:08.603812+0000","last_active":"2024-04-16T12:55:16.368816+0000","last_peered":"2024-04-16T12:55:16.368816+0000","last_clean":"2024-04-16T12:55:16.368816+0000","last_became_active":"2024-04-16T12:55:08.603521+0000","last_became_peered":"2024-04-16T12:55:08.603521+0000","last_unstale":"2024-04-16T12:55:16.368816+0000","last_undegraded":"2024-04-16T12:55:16.368816+0000","last_fullsized":"2024-04-16T12:55:16.368816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:29.707733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633822+0000","last_change":"2024-04-16T12:55:09.599628+0000","last_active":"2024-04-16T12:55:14.633822+0000","last_peered":"2024-04-16T12:55:14.633822+0000","last_clean":"2024-04-16T12:55:14.633822+0000","last_became_active":"2024-04-16T12:55:09.599322+0000","last_became_peered":"2024-04-16T12:55:09.599322+0000","last_unstale":"2024-04-16T12:55:14.633822+0000","last_undegraded":"2024-04-16T12:55:14.633822+0000","last_fullsized":"2024-04-16T12:55:14.633822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369484+0000","last_change":"2024-04-16T12:55:13.644781+0000","last_active":"2024-04-16T12:55:16.369484+0000","last_peered":"2024-04-16T12:55:16.369484+0000","last_clean":"2024-04-16T12:55:16.369484+0000","last_became_active":"2024-04-16T12:55:13.644284+0000","last_became_peered":"2024-04-16T12:55:13.644284+0000","last_unstale":"2024-04-16T12:55:16.369484+0000","last_undegraded":"2024-04-16T12:55:16.369484+0000","last_fullsized":"2024-04-16T12:55:16.369484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367966+0000","last_change":"2024-04-16T12:55:08.606441+0000","last_active":"2024-04-16T12:55:16.367966+0000","last_peered":"2024-04-16T12:55:16.367966+0000","last_clean":"2024-04-16T12:55:16.367966+0000","last_became_active":"2024-04-16T12:55:08.606162+0000","last_became_peered":"2024-04-16T12:55:08.606162+0000","last_unstale":"2024-04-16T12:55:16.367966+0000","last_undegraded":"2024-04-16T12:55:16.367966+0000","last_fullsized":"2024-04-16T12:55:16.367966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634055+0000","last_change":"2024-04-16T12:55:09.605124+0000","last_active":"2024-04-16T12:55:14.634055+0000","last_peered":"2024-04-16T12:55:14.634055+0000","last_clean":"2024-04-16T12:55:14.634055+0000","last_became_active":"2024-04-16T12:55:09.604225+0000","last_became_peered":"2024-04-16T12:55:09.604225+0000","last_unstale":"2024-04-16T12:55:14.634055+0000","last_undegraded":"2024-04-16T12:55:14.634055+0000","last_fullsized":"2024-04-16T12:55:14.634055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367712+0000","last_change":"2024-04-16T12:55:13.643994+0000","last_active":"2024-04-16T12:55:16.367712+0000","last_peered":"2024-04-16T12:55:16.367712+0000","last_clean":"2024-04-16T12:55:16.367712+0000","last_became_active":"2024-04-16T12:55:13.643551+0000","last_became_peered":"2024-04-16T12:55:13.643551+0000","last_unstale":"2024-04-16T12:55:16.367712+0000","last_undegraded":"2024-04-16T12:55:16.367712+0000","last_fullsized":"2024-04-16T12:55:16.367712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:07.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368044+0000","last_change":"2024-04-16T12:55:09.617118+0000","last_active":"2024-04-16T12:55:16.368044+0000","last_peered":"2024-04-16T12:55:16.368044+0000","last_clean":"2024-04-16T12:55:16.368044+0000","last_became_active":"2024-04-16T12:55:09.616808+0000","last_became_peered":"2024-04-16T12:55:09.616808+0000","last_unstale":"2024-04-16T12:55:16.368044+0000","last_undegraded":"2024-04-16T12:55:16.368044+0000","last_fullsized":"2024-04-16T12:55:16.368044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368824+0000","last_change":"2024-04-16T12:55:08.602196+0000","last_active":"2024-04-16T12:55:16.368824+0000","last_peered":"2024-04-16T12:55:16.368824+0000","last_clean":"2024-04-16T12:55:16.368824+0000","last_became_active":"2024-04-16T12:55:08.601896+0000","last_became_peered":"2024-04-16T12:55:08.601896+0000","last_unstale":"2024-04-16T12:55:16.368824+0000","last_undegraded":"2024-04-16T12:55:16.368824+0000","last_fullsized":"2024-04-16T12:55:16.368824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:44.870969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368907+0000","last_change":"2024-04-16T12:55:13.642915+0000","last_active":"2024-04-16T12:55:16.368907+0000","last_peered":"2024-04-16T12:55:16.368907+0000","last_clean":"2024-04-16T12:55:16.368907+0000","last_became_active":"2024-04-16T12:55:13.642404+0000","last_became_peered":"2024-04-16T12:55:13.642404+0000","last_unstale":"2024-04-16T12:55:16.368907+0000","last_undegraded":"2024-04-16T12:55:16.368907+0000","last_fullsized":"2024-04-16T12:55:16.368907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:12.774418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694920+0000","last_change":"2024-04-16T12:55:09.609312+0000","last_active":"2024-04-16T12:55:14.694920+0000","last_peered":"2024-04-16T12:55:14.694920+0000","last_clean":"2024-04-16T12:55:14.694920+0000","last_became_active":"2024-04-16T12:55:09.608972+0000","last_became_peered":"2024-04-16T12:55:09.608972+0000","last_unstale":"2024-04-16T12:55:14.694920+0000","last_undegraded":"2024-04-16T12:55:14.694920+0000","last_fullsized":"2024-04-16T12:55:14.694920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633101+0000","last_change":"2024-04-16T12:55:08.604374+0000","last_active":"2024-04-16T12:55:14.633101+0000","last_peered":"2024-04-16T12:55:14.633101+0000","last_clean":"2024-04-16T12:55:14.633101+0000","last_became_active":"2024-04-16T12:55:08.603813+0000","last_became_peered":"2024-04-16T12:55:08.603813+0000","last_unstale":"2024-04-16T12:55:14.633101+0000","last_undegraded":"2024-04-16T12:55:14.633101+0000","last_fullsized":"2024-04-16T12:55:14.633101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368459+0000","last_change":"2024-04-16T12:55:13.643708+0000","last_active":"2024-04-16T12:55:16.368459+0000","last_peered":"2024-04-16T12:55:16.368459+0000","last_clean":"2024-04-16T12:55:16.368459+0000","last_became_active":"2024-04-16T12:55:13.643298+0000","last_became_peered":"2024-04-16T12:55:13.643298+0000","last_unstale":"2024-04-16T12:55:16.368459+0000","last_undegraded":"2024-04-16T12:55:16.368459+0000","last_fullsized":"2024-04-16T12:55:16.368459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:46.270789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694839+0000","last_change":"2024-04-16T12:55:09.608016+0000","last_active":"2024-04-16T12:55:14.694839+0000","last_peered":"2024-04-16T12:55:14.694839+0000","last_clean":"2024-04-16T12:55:14.694839+0000","last_became_active":"2024-04-16T12:55:09.607708+0000","last_became_peered":"2024-04-16T12:55:09.607708+0000","last_unstale":"2024-04-16T12:55:14.694839+0000","last_undegraded":"2024-04-16T12:55:14.694839+0000","last_fullsized":"2024-04-16T12:55:14.694839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632908+0000","last_change":"2024-04-16T12:55:08.604999+0000","last_active":"2024-04-16T12:55:14.632908+0000","last_peered":"2024-04-16T12:55:14.632908+0000","last_clean":"2024-04-16T12:55:14.632908+0000","last_became_active":"2024-04-16T12:55:08.603479+0000","last_became_peered":"2024-04-16T12:55:08.603479+0000","last_unstale":"2024-04-16T12:55:14.632908+0000","last_undegraded":"2024-04-16T12:55:14.632908+0000","last_fullsized":"2024-04-16T12:55:14.632908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633683+0000","last_change":"2024-04-16T12:55:13.984277+0000","last_active":"2024-04-16T12:55:14.633683+0000","last_peered":"2024-04-16T12:55:14.633683+0000","last_clean":"2024-04-16T12:55:14.633683+0000","last_became_active":"2024-04-16T12:55:13.983911+0000","last_became_peered":"2024-04-16T12:55:13.983911+0000","last_unstale":"2024-04-16T12:55:14.633683+0000","last_undegraded":"2024-04-16T12:55:14.633683+0000","last_fullsized":"2024-04-16T12:55:14.633683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369689+0000","last_change":"2024-04-16T12:55:09.597064+0000","last_active":"2024-04-16T12:55:16.369689+0000","last_peered":"2024-04-16T12:55:16.369689+0000","last_clean":"2024-04-16T12:55:16.369689+0000","last_became_active":"2024-04-16T12:55:09.596531+0000","last_became_peered":"2024-04-16T12:55:09.596531+0000","last_unstale":"2024-04-16T12:55:16.369689+0000","last_undegraded":"2024-04-16T12:55:16.369689+0000","last_fullsized":"2024-04-16T12:55:16.369689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:41.388856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368817+0000","last_change":"2024-04-16T12:55:08.602603+0000","last_active":"2024-04-16T12:55:16.368817+0000","last_peered":"2024-04-16T12:55:16.368817+0000","last_clean":"2024-04-16T12:55:16.368817+0000","last_became_active":"2024-04-16T12:55:08.602324+0000","last_became_peered":"2024-04-16T12:55:08.602324+0000","last_unstale":"2024-04-16T12:55:16.368817+0000","last_undegraded":"2024-04-16T12:55:16.368817+0000","last_fullsized":"2024-04-16T12:55:16.368817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369344+0000","last_change":"2024-04-16T12:55:13.644854+0000","last_active":"2024-04-16T12:55:16.369344+0000","last_peered":"2024-04-16T12:55:16.369344+0000","last_clean":"2024-04-16T12:55:16.369344+0000","last_became_active":"2024-04-16T12:55:13.644347+0000","last_became_peered":"2024-04-16T12:55:13.644347+0000","last_unstale":"2024-04-16T12:55:16.369344+0000","last_undegraded":"2024-04-16T12:55:16.369344+0000","last_fullsized":"2024-04-16T12:55:16.369344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367451+0000","last_change":"2024-04-16T12:55:09.607401+0000","last_active":"2024-04-16T12:55:16.367451+0000","last_peered":"2024-04-16T12:55:16.367451+0000","last_clean":"2024-04-16T12:55:16.367451+0000","last_became_active":"2024-04-16T12:55:09.607073+0000","last_became_peered":"2024-04-16T12:55:09.607073+0000","last_unstale":"2024-04-16T12:55:16.367451+0000","last_undegraded":"2024-04-16T12:55:16.367451+0000","last_fullsized":"2024-04-16T12:55:16.367451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369471+0000","last_change":"2024-04-16T12:55:08.604773+0000","last_active":"2024-04-16T12:55:16.369471+0000","last_peered":"2024-04-16T12:55:16.369471+0000","last_clean":"2024-04-16T12:55:16.369471+0000","last_became_active":"2024-04-16T12:55:08.604275+0000","last_became_peered":"2024-04-16T12:55:08.604275+0000","last_unstale":"2024-04-16T12:55:16.369471+0000","last_undegraded":"2024-04-16T12:55:16.369471+0000","last_fullsized":"2024-04-16T12:55:16.369471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369565+0000","last_change":"2024-04-16T12:55:13.984733+0000","last_active":"2024-04-16T12:55:16.369565+0000","last_peered":"2024-04-16T12:55:16.369565+0000","last_clean":"2024-04-16T12:55:16.369565+0000","last_became_active":"2024-04-16T12:55:13.983970+0000","last_became_peered":"2024-04-16T12:55:13.983970+0000","last_unstale":"2024-04-16T12:55:16.369565+0000","last_undegraded":"2024-04-16T12:55:16.369565+0000","last_fullsized":"2024-04-16T12:55:16.369565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695546+0000","last_change":"2024-04-16T12:55:09.612698+0000","last_active":"2024-04-16T12:55:14.695546+0000","last_peered":"2024-04-16T12:55:14.695546+0000","last_clean":"2024-04-16T12:55:14.695546+0000","last_became_active":"2024-04-16T12:55:09.612401+0000","last_became_peered":"2024-04-16T12:55:09.612401+0000","last_unstale":"2024-04-16T12:55:14.695546+0000","last_undegraded":"2024-04-16T12:55:14.695546+0000","last_fullsized":"2024-04-16T12:55:14.695546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633691+0000","last_change":"2024-04-16T12:55:08.602265+0000","last_active":"2024-04-16T12:55:14.633691+0000","last_peered":"2024-04-16T12:55:14.633691+0000","last_clean":"2024-04-16T12:55:14.633691+0000","last_became_active":"2024-04-16T12:55:08.601969+0000","last_became_peered":"2024-04-16T12:55:08.601969+0000","last_unstale":"2024-04-16T12:55:14.633691+0000","last_undegraded":"2024-04-16T12:55:14.633691+0000","last_fullsized":"2024-04-16T12:55:14.633691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694594+0000","last_change":"2024-04-16T12:55:13.981871+0000","last_active":"2024-04-16T12:55:14.694594+0000","last_peered":"2024-04-16T12:55:14.694594+0000","last_clean":"2024-04-16T12:55:14.694594+0000","last_became_active":"2024-04-16T12:55:13.981491+0000","last_became_peered":"2024-04-16T12:55:13.981491+0000","last_unstale":"2024-04-16T12:55:14.694594+0000","last_undegraded":"2024-04-16T12:55:14.694594+0000","last_fullsized":"2024-04-16T12:55:14.694594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:58.777887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633569+0000","last_change":"2024-04-16T12:55:09.608036+0000","last_active":"2024-04-16T12:55:14.633569+0000","last_peered":"2024-04-16T12:55:14.633569+0000","last_clean":"2024-04-16T12:55:14.633569+0000","last_became_active":"2024-04-16T12:55:09.607748+0000","last_became_peered":"2024-04-16T12:55:09.607748+0000","last_unstale":"2024-04-16T12:55:14.633569+0000","last_undegraded":"2024-04-16T12:55:14.633569+0000","last_fullsized":"2024-04-16T12:55:14.633569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368966+0000","last_change":"2024-04-16T12:55:08.606601+0000","last_active":"2024-04-16T12:55:16.368966+0000","last_peered":"2024-04-16T12:55:16.368966+0000","last_clean":"2024-04-16T12:55:16.368966+0000","last_became_active":"2024-04-16T12:55:08.606293+0000","last_became_peered":"2024-04-16T12:55:08.606293+0000","last_unstale":"2024-04-16T12:55:16.368966+0000","last_undegraded":"2024-04-16T12:55:16.368966+0000","last_fullsized":"2024-04-16T12:55:16.368966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:02.120498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367098+0000","last_change":"2024-04-16T12:55:13.981993+0000","last_active":"2024-04-16T12:55:16.367098+0000","last_peered":"2024-04-16T12:55:16.367098+0000","last_clean":"2024-04-16T12:55:16.367098+0000","last_became_active":"2024-04-16T12:55:13.981384+0000","last_became_peered":"2024-04-16T12:55:13.981384+0000","last_unstale":"2024-04-16T12:55:16.367098+0000","last_undegraded":"2024-04-16T12:55:16.367098+0000","last_fullsized":"2024-04-16T12:55:16.367098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634120+0000","last_change":"2024-04-16T12:55:09.616638+0000","last_active":"2024-04-16T12:55:14.634120+0000","last_peered":"2024-04-16T12:55:14.634120+0000","last_clean":"2024-04-16T12:55:14.634120+0000","last_became_active":"2024-04-16T12:55:09.616217+0000","last_became_peered":"2024-04-16T12:55:09.616217+0000","last_unstale":"2024-04-16T12:55:14.634120+0000","last_undegraded":"2024-04-16T12:55:14.634120+0000","last_fullsized":"2024-04-16T12:55:14.634120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633590+0000","last_change":"2024-04-16T12:55:08.598000+0000","last_active":"2024-04-16T12:55:14.633590+0000","last_peered":"2024-04-16T12:55:14.633590+0000","last_clean":"2024-04-16T12:55:14.633590+0000","last_became_active":"2024-04-16T12:55:08.597703+0000","last_became_peered":"2024-04-16T12:55:08.597703+0000","last_unstale":"2024-04-16T12:55:14.633590+0000","last_undegraded":"2024-04-16T12:55:14.633590+0000","last_fullsized":"2024-04-16T12:55:14.633590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632782+0000","last_change":"2024-04-16T12:55:13.646625+0000","last_active":"2024-04-16T12:55:14.632782+0000","last_peered":"2024-04-16T12:55:14.632782+0000","last_clean":"2024-04-16T12:55:14.632782+0000","last_became_active":"2024-04-16T12:55:13.646260+0000","last_became_peered":"2024-04-16T12:55:13.646260+0000","last_unstale":"2024-04-16T12:55:14.632782+0000","last_undegraded":"2024-04-16T12:55:14.632782+0000","last_fullsized":"2024-04-16T12:55:14.632782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369676+0000","last_change":"2024-04-16T12:55:09.600934+0000","last_active":"2024-04-16T12:55:16.369676+0000","last_peered":"2024-04-16T12:55:16.369676+0000","last_clean":"2024-04-16T12:55:16.369676+0000","last_became_active":"2024-04-16T12:55:09.600399+0000","last_became_peered":"2024-04-16T12:55:09.600399+0000","last_unstale":"2024-04-16T12:55:16.369676+0000","last_undegraded":"2024-04-16T12:55:16.369676+0000","last_fullsized":"2024-04-16T12:55:16.369676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:43.700295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633893+0000","last_change":"2024-04-16T12:55:08.604212+0000","last_active":"2024-04-16T12:55:14.633893+0000","last_peered":"2024-04-16T12:55:14.633893+0000","last_clean":"2024-04-16T12:55:14.633893+0000","last_became_active":"2024-04-16T12:55:08.603941+0000","last_became_peered":"2024-04-16T12:55:08.603941+0000","last_unstale":"2024-04-16T12:55:14.633893+0000","last_undegraded":"2024-04-16T12:55:14.633893+0000","last_fullsized":"2024-04-16T12:55:14.633893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633482+0000","last_change":"2024-04-16T12:55:13.648783+0000","last_active":"2024-04-16T12:55:14.633482+0000","last_peered":"2024-04-16T12:55:14.633482+0000","last_clean":"2024-04-16T12:55:14.633482+0000","last_became_active":"2024-04-16T12:55:13.648394+0000","last_became_peered":"2024-04-16T12:55:13.648394+0000","last_unstale":"2024-04-16T12:55:14.633482+0000","last_undegraded":"2024-04-16T12:55:14.633482+0000","last_fullsized":"2024-04-16T12:55:14.633482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633151+0000","last_change":"2024-04-16T12:55:09.610829+0000","last_active":"2024-04-16T12:55:14.633151+0000","last_peered":"2024-04-16T12:55:14.633151+0000","last_clean":"2024-04-16T12:55:14.633151+0000","last_became_active":"2024-04-16T12:55:09.607200+0000","last_became_peered":"2024-04-16T12:55:09.607200+0000","last_unstale":"2024-04-16T12:55:14.633151+0000","last_undegraded":"2024-04-16T12:55:14.633151+0000","last_fullsized":"2024-04-16T12:55:14.633151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631656+0000","last_change":"2024-04-16T12:55:08.604218+0000","last_active":"2024-04-16T12:55:14.631656+0000","last_peered":"2024-04-16T12:55:14.631656+0000","last_clean":"2024-04-16T12:55:14.631656+0000","last_became_active":"2024-04-16T12:55:08.603910+0000","last_became_peered":"2024-04-16T12:55:08.603910+0000","last_unstale":"2024-04-16T12:55:14.631656+0000","last_undegraded":"2024-04-16T12:55:14.631656+0000","last_fullsized":"2024-04-16T12:55:14.631656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633704+0000","last_change":"2024-04-16T12:55:13.647025+0000","last_active":"2024-04-16T12:55:14.633704+0000","last_peered":"2024-04-16T12:55:14.633704+0000","last_clean":"2024-04-16T12:55:14.633704+0000","last_became_active":"2024-04-16T12:55:13.646214+0000","last_became_peered":"2024-04-16T12:55:13.646214+0000","last_unstale":"2024-04-16T12:55:14.633704+0000","last_undegraded":"2024-04-16T12:55:14.633704+0000","last_fullsized":"2024-04-16T12:55:14.633704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.366914+0000","last_change":"2024-04-16T12:55:09.600161+0000","last_active":"2024-04-16T12:55:16.366914+0000","last_peered":"2024-04-16T12:55:16.366914+0000","last_clean":"2024-04-16T12:55:16.366914+0000","last_became_active":"2024-04-16T12:55:09.599040+0000","last_became_peered":"2024-04-16T12:55:09.599040+0000","last_unstale":"2024-04-16T12:55:16.366914+0000","last_undegraded":"2024-04-16T12:55:16.366914+0000","last_fullsized":"2024-04-16T12:55:16.366914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:03.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369035+0000","last_change":"2024-04-16T12:55:08.602446+0000","last_active":"2024-04-16T12:55:16.369035+0000","last_peered":"2024-04-16T12:55:16.369035+0000","last_clean":"2024-04-16T12:55:16.369035+0000","last_became_active":"2024-04-16T12:55:08.602174+0000","last_became_peered":"2024-04-16T12:55:08.602174+0000","last_unstale":"2024-04-16T12:55:16.369035+0000","last_undegraded":"2024-04-16T12:55:16.369035+0000","last_fullsized":"2024-04-16T12:55:16.369035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367361+0000","last_change":"2024-04-16T12:55:13.981927+0000","last_active":"2024-04-16T12:55:16.367361+0000","last_peered":"2024-04-16T12:55:16.367361+0000","last_clean":"2024-04-16T12:55:16.367361+0000","last_became_active":"2024-04-16T12:55:13.981550+0000","last_became_peered":"2024-04-16T12:55:13.981550+0000","last_unstale":"2024-04-16T12:55:16.367361+0000","last_undegraded":"2024-04-16T12:55:16.367361+0000","last_fullsized":"2024-04-16T12:55:16.367361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:30.099478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694649+0000","last_change":"2024-04-16T12:55:09.615938+0000","last_active":"2024-04-16T12:55:14.694649+0000","last_peered":"2024-04-16T12:55:14.694649+0000","last_clean":"2024-04-16T12:55:14.694649+0000","last_became_active":"2024-04-16T12:55:09.615177+0000","last_became_peered":"2024-04-16T12:55:09.615177+0000","last_unstale":"2024-04-16T12:55:14.694649+0000","last_undegraded":"2024-04-16T12:55:14.694649+0000","last_fullsized":"2024-04-16T12:55:14.694649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633571+0000","last_change":"2024-04-16T12:55:08.599197+0000","last_active":"2024-04-16T12:55:14.633571+0000","last_peered":"2024-04-16T12:55:14.633571+0000","last_clean":"2024-04-16T12:55:14.633571+0000","last_became_active":"2024-04-16T12:55:08.598892+0000","last_became_peered":"2024-04-16T12:55:08.598892+0000","last_unstale":"2024-04-16T12:55:14.633571+0000","last_undegraded":"2024-04-16T12:55:14.633571+0000","last_fullsized":"2024-04-16T12:55:14.633571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368934+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:55:16.368934+0000","last_peered":"2024-04-16T12:55:16.368934+0000","last_clean":"2024-04-16T12:55:16.368934+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:55:16.368934+0000","last_undegraded":"2024-04-16T12:55:16.368934+0000","last_fullsized":"2024-04-16T12:55:16.368934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368883+0000","last_change":"2024-04-16T12:55:13.983109+0000","last_active":"2024-04-16T12:55:16.368883+0000","last_peered":"2024-04-16T12:55:16.368883+0000","last_clean":"2024-04-16T12:55:16.368883+0000","last_became_active":"2024-04-16T12:55:13.982685+0000","last_became_peered":"2024-04-16T12:55:13.982685+0000","last_unstale":"2024-04-16T12:55:16.368883+0000","last_undegraded":"2024-04-16T12:55:16.368883+0000","last_fullsized":"2024-04-16T12:55:16.368883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368489+0000","last_change":"2024-04-16T12:55:09.615455+0000","last_active":"2024-04-16T12:55:16.368489+0000","last_peered":"2024-04-16T12:55:16.368489+0000","last_clean":"2024-04-16T12:55:16.368489+0000","last_became_active":"2024-04-16T12:55:09.614879+0000","last_became_peered":"2024-04-16T12:55:09.614879+0000","last_unstale":"2024-04-16T12:55:16.368489+0000","last_undegraded":"2024-04-16T12:55:16.368489+0000","last_fullsized":"2024-04-16T12:55:16.368489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631857+0000","last_change":"2024-04-16T12:55:08.602417+0000","last_active":"2024-04-16T12:55:14.631857+0000","last_peered":"2024-04-16T12:55:14.631857+0000","last_clean":"2024-04-16T12:55:14.631857+0000","last_became_active":"2024-04-16T12:55:08.602116+0000","last_became_peered":"2024-04-16T12:55:08.602116+0000","last_unstale":"2024-04-16T12:55:14.631857+0000","last_undegraded":"2024-04-16T12:55:14.631857+0000","last_fullsized":"2024-04-16T12:55:14.631857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367931+0000","last_change":"2024-04-16T12:55:13.982825+0000","last_active":"2024-04-16T12:55:16.367931+0000","last_peered":"2024-04-16T12:55:16.367931+0000","last_clean":"2024-04-16T12:55:16.367931+0000","last_became_active":"2024-04-16T12:55:13.981463+0000","last_became_peered":"2024-04-16T12:55:13.981463+0000","last_unstale":"2024-04-16T12:55:16.367931+0000","last_undegraded":"2024-04-16T12:55:16.367931+0000","last_fullsized":"2024-04-16T12:55:16.367931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633956+0000","last_change":"2024-04-16T12:55:09.615888+0000","last_active":"2024-04-16T12:55:14.633956+0000","last_peered":"2024-04-16T12:55:14.633956+0000","last_clean":"2024-04-16T12:55:14.633956+0000","last_became_active":"2024-04-16T12:55:09.615272+0000","last_became_peered":"2024-04-16T12:55:09.615272+0000","last_unstale":"2024-04-16T12:55:14.633956+0000","last_undegraded":"2024-04-16T12:55:14.633956+0000","last_fullsized":"2024-04-16T12:55:14.633956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633411+0000","last_change":"2024-04-16T12:55:08.601281+0000","last_active":"2024-04-16T12:55:14.633411+0000","last_peered":"2024-04-16T12:55:14.633411+0000","last_clean":"2024-04-16T12:55:14.633411+0000","last_became_active":"2024-04-16T12:55:08.600899+0000","last_became_peered":"2024-04-16T12:55:08.600899+0000","last_unstale":"2024-04-16T12:55:14.633411+0000","last_undegraded":"2024-04-16T12:55:14.633411+0000","last_fullsized":"2024-04-16T12:55:14.633411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367245+0000","last_change":"2024-04-16T12:55:13.647207+0000","last_active":"2024-04-16T12:55:16.367245+0000","last_peered":"2024-04-16T12:55:16.367245+0000","last_clean":"2024-04-16T12:55:16.367245+0000","last_became_active":"2024-04-16T12:55:13.646389+0000","last_became_peered":"2024-04-16T12:55:13.646389+0000","last_unstale":"2024-04-16T12:55:16.367245+0000","last_undegraded":"2024-04-16T12:55:16.367245+0000","last_fullsized":"2024-04-16T12:55:16.367245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368504+0000","last_change":"2024-04-16T12:55:09.617673+0000","last_active":"2024-04-16T12:55:16.368504+0000","last_peered":"2024-04-16T12:55:16.368504+0000","last_clean":"2024-04-16T12:55:16.368504+0000","last_became_active":"2024-04-16T12:55:09.617168+0000","last_became_peered":"2024-04-16T12:55:09.617168+0000","last_unstale":"2024-04-16T12:55:16.368504+0000","last_undegraded":"2024-04-16T12:55:16.368504+0000","last_fullsized":"2024-04-16T12:55:16.368504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:18.474748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632028+0000","last_change":"2024-04-16T12:55:08.603386+0000","last_active":"2024-04-16T12:55:14.632028+0000","last_peered":"2024-04-16T12:55:14.632028+0000","last_clean":"2024-04-16T12:55:14.632028+0000","last_became_active":"2024-04-16T12:55:08.603101+0000","last_became_peered":"2024-04-16T12:55:08.603101+0000","last_unstale":"2024-04-16T12:55:14.632028+0000","last_undegraded":"2024-04-16T12:55:14.632028+0000","last_fullsized":"2024-04-16T12:55:14.632028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633245+0000","last_change":"2024-04-16T12:55:13.982430+0000","last_active":"2024-04-16T12:55:14.633245+0000","last_peered":"2024-04-16T12:55:14.633245+0000","last_clean":"2024-04-16T12:55:14.633245+0000","last_became_active":"2024-04-16T12:55:13.982015+0000","last_became_peered":"2024-04-16T12:55:13.982015+0000","last_unstale":"2024-04-16T12:55:14.633245+0000","last_undegraded":"2024-04-16T12:55:14.633245+0000","last_fullsized":"2024-04-16T12:55:14.633245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368249+0000","last_change":"2024-04-16T12:55:09.616105+0000","last_active":"2024-04-16T12:55:16.368249+0000","last_peered":"2024-04-16T12:55:16.368249+0000","last_clean":"2024-04-16T12:55:16.368249+0000","last_became_active":"2024-04-16T12:55:09.615832+0000","last_became_peered":"2024-04-16T12:55:09.615832+0000","last_unstale":"2024-04-16T12:55:16.368249+0000","last_undegraded":"2024-04-16T12:55:16.368249+0000","last_fullsized":"2024-04-16T12:55:16.368249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368416+0000","last_change":"2024-04-16T12:55:08.603695+0000","last_active":"2024-04-16T12:55:16.368416+0000","last_peered":"2024-04-16T12:55:16.368416+0000","last_clean":"2024-04-16T12:55:16.368416+0000","last_became_active":"2024-04-16T12:55:08.603425+0000","last_became_peered":"2024-04-16T12:55:08.603425+0000","last_unstale":"2024-04-16T12:55:16.368416+0000","last_undegraded":"2024-04-16T12:55:16.368416+0000","last_fullsized":"2024-04-16T12:55:16.368416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369160+0000","last_change":"2024-04-16T12:55:13.644589+0000","last_active":"2024-04-16T12:55:16.369160+0000","last_peered":"2024-04-16T12:55:16.369160+0000","last_clean":"2024-04-16T12:55:16.369160+0000","last_became_active":"2024-04-16T12:55:13.644211+0000","last_became_peered":"2024-04-16T12:55:13.644211+0000","last_unstale":"2024-04-16T12:55:16.369160+0000","last_undegraded":"2024-04-16T12:55:16.369160+0000","last_fullsized":"2024-04-16T12:55:16.369160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:38.226650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368542+0000","last_change":"2024-04-16T12:55:09.615275+0000","last_active":"2024-04-16T12:55:16.368542+0000","last_peered":"2024-04-16T12:55:16.368542+0000","last_clean":"2024-04-16T12:55:16.368542+0000","last_became_active":"2024-04-16T12:55:09.614772+0000","last_became_peered":"2024-04-16T12:55:09.614772+0000","last_unstale":"2024-04-16T12:55:16.368542+0000","last_undegraded":"2024-04-16T12:55:16.368542+0000","last_fullsized":"2024-04-16T12:55:16.368542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631386+0000","last_change":"2024-04-16T12:55:08.598164+0000","last_active":"2024-04-16T12:55:14.631386+0000","last_peered":"2024-04-16T12:55:14.631386+0000","last_clean":"2024-04-16T12:55:14.631386+0000","last_became_active":"2024-04-16T12:55:08.597846+0000","last_became_peered":"2024-04-16T12:55:08.597846+0000","last_unstale":"2024-04-16T12:55:14.631386+0000","last_undegraded":"2024-04-16T12:55:14.631386+0000","last_fullsized":"2024-04-16T12:55:14.631386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367265+0000","last_change":"2024-04-16T12:55:13.640511+0000","last_active":"2024-04-16T12:55:16.367265+0000","last_peered":"2024-04-16T12:55:16.367265+0000","last_clean":"2024-04-16T12:55:16.367265+0000","last_became_active":"2024-04-16T12:55:13.639882+0000","last_became_peered":"2024-04-16T12:55:13.639882+0000","last_unstale":"2024-04-16T12:55:16.367265+0000","last_undegraded":"2024-04-16T12:55:16.367265+0000","last_fullsized":"2024-04-16T12:55:16.367265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367597+0000","last_change":"2024-04-16T12:55:09.609001+0000","last_active":"2024-04-16T12:55:16.367597+0000","last_peered":"2024-04-16T12:55:16.367597+0000","last_clean":"2024-04-16T12:55:16.367597+0000","last_became_active":"2024-04-16T12:55:09.608734+0000","last_became_peered":"2024-04-16T12:55:09.608734+0000","last_unstale":"2024-04-16T12:55:16.367597+0000","last_undegraded":"2024-04-16T12:55:16.367597+0000","last_fullsized":"2024-04-16T12:55:16.367597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367952+0000","last_change":"2024-04-16T12:55:08.603335+0000","last_active":"2024-04-16T12:55:16.367952+0000","last_peered":"2024-04-16T12:55:16.367952+0000","last_clean":"2024-04-16T12:55:16.367952+0000","last_became_active":"2024-04-16T12:55:08.602990+0000","last_became_peered":"2024-04-16T12:55:08.602990+0000","last_unstale":"2024-04-16T12:55:16.367952+0000","last_undegraded":"2024-04-16T12:55:16.367952+0000","last_fullsized":"2024-04-16T12:55:16.367952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695518+0000","last_change":"2024-04-16T12:55:13.982306+0000","last_active":"2024-04-16T12:55:14.695518+0000","last_peered":"2024-04-16T12:55:14.695518+0000","last_clean":"2024-04-16T12:55:14.695518+0000","last_became_active":"2024-04-16T12:55:13.981930+0000","last_became_peered":"2024-04-16T12:55:13.981930+0000","last_unstale":"2024-04-16T12:55:14.695518+0000","last_undegraded":"2024-04-16T12:55:14.695518+0000","last_fullsized":"2024-04-16T12:55:14.695518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:08.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368720+0000","last_change":"2024-04-16T12:55:09.614600+0000","last_active":"2024-04-16T12:55:16.368720+0000","last_peered":"2024-04-16T12:55:16.368720+0000","last_clean":"2024-04-16T12:55:16.368720+0000","last_became_active":"2024-04-16T12:55:09.614325+0000","last_became_peered":"2024-04-16T12:55:09.614325+0000","last_unstale":"2024-04-16T12:55:16.368720+0000","last_undegraded":"2024-04-16T12:55:16.368720+0000","last_fullsized":"2024-04-16T12:55:16.368720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633785+0000","last_change":"2024-04-16T12:55:08.608010+0000","last_active":"2024-04-16T12:55:14.633785+0000","last_peered":"2024-04-16T12:55:14.633785+0000","last_clean":"2024-04-16T12:55:14.633785+0000","last_became_active":"2024-04-16T12:55:08.607694+0000","last_became_peered":"2024-04-16T12:55:08.607694+0000","last_unstale":"2024-04-16T12:55:14.633785+0000","last_undegraded":"2024-04-16T12:55:14.633785+0000","last_fullsized":"2024-04-16T12:55:14.633785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695213+0000","last_change":"2024-04-16T12:55:13.981780+0000","last_active":"2024-04-16T12:55:14.695213+0000","last_peered":"2024-04-16T12:55:14.695213+0000","last_clean":"2024-04-16T12:55:14.695213+0000","last_became_active":"2024-04-16T12:55:13.981378+0000","last_became_peered":"2024-04-16T12:55:13.981378+0000","last_unstale":"2024-04-16T12:55:14.695213+0000","last_undegraded":"2024-04-16T12:55:14.695213+0000","last_fullsized":"2024-04-16T12:55:14.695213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:34.588593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367107+0000","last_change":"2024-04-16T12:55:09.611318+0000","last_active":"2024-04-16T12:55:16.367107+0000","last_peered":"2024-04-16T12:55:16.367107+0000","last_clean":"2024-04-16T12:55:16.367107+0000","last_became_active":"2024-04-16T12:55:09.611021+0000","last_became_peered":"2024-04-16T12:55:09.611021+0000","last_unstale":"2024-04-16T12:55:16.367107+0000","last_undegraded":"2024-04-16T12:55:16.367107+0000","last_fullsized":"2024-04-16T12:55:16.367107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:22.528974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367349+0000","last_change":"2024-04-16T12:55:08.601634+0000","last_active":"2024-04-16T12:55:16.367349+0000","last_peered":"2024-04-16T12:55:16.367349+0000","last_clean":"2024-04-16T12:55:16.367349+0000","last_became_active":"2024-04-16T12:55:08.601348+0000","last_became_peered":"2024-04-16T12:55:08.601348+0000","last_unstale":"2024-04-16T12:55:16.367349+0000","last_undegraded":"2024-04-16T12:55:16.367349+0000","last_fullsized":"2024-04-16T12:55:16.367349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:39.045294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634061+0000","last_change":"2024-04-16T12:55:13.982101+0000","last_active":"2024-04-16T12:55:14.634061+0000","last_peered":"2024-04-16T12:55:14.634061+0000","last_clean":"2024-04-16T12:55:14.634061+0000","last_became_active":"2024-04-16T12:55:13.981652+0000","last_became_peered":"2024-04-16T12:55:13.981652+0000","last_unstale":"2024-04-16T12:55:14.634061+0000","last_undegraded":"2024-04-16T12:55:14.634061+0000","last_fullsized":"2024-04-16T12:55:14.634061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368372+0000","last_change":"2024-04-16T12:55:09.620820+0000","last_active":"2024-04-16T12:55:16.368372+0000","last_peered":"2024-04-16T12:55:16.368372+0000","last_clean":"2024-04-16T12:55:16.368372+0000","last_became_active":"2024-04-16T12:55:09.620534+0000","last_became_peered":"2024-04-16T12:55:09.620534+0000","last_unstale":"2024-04-16T12:55:16.368372+0000","last_undegraded":"2024-04-16T12:55:16.368372+0000","last_fullsized":"2024-04-16T12:55:16.368372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:19.234376+0000","last_change":"2024-04-16T12:55:08.605338+0000","last_active":"2024-04-16T12:55:19.234376+0000","last_peered":"2024-04-16T12:55:19.234376+0000","last_clean":"2024-04-16T12:55:19.234376+0000","last_became_active":"2024-04-16T12:55:08.604774+0000","last_became_peered":"2024-04-16T12:55:08.604774+0000","last_unstale":"2024-04-16T12:55:19.234376+0000","last_undegraded":"2024-04-16T12:55:19.234376+0000","last_fullsized":"2024-04-16T12:55:19.234376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633006+0000","last_change":"2024-04-16T12:55:13.646516+0000","last_active":"2024-04-16T12:55:14.633006+0000","last_peered":"2024-04-16T12:55:14.633006+0000","last_clean":"2024-04-16T12:55:14.633006+0000","last_became_active":"2024-04-16T12:55:13.645703+0000","last_became_peered":"2024-04-16T12:55:13.645703+0000","last_unstale":"2024-04-16T12:55:14.633006+0000","last_undegraded":"2024-04-16T12:55:14.633006+0000","last_fullsized":"2024-04-16T12:55:14.633006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369060+0000","last_change":"2024-04-16T12:55:09.606507+0000","last_active":"2024-04-16T12:55:16.369060+0000","last_peered":"2024-04-16T12:55:16.369060+0000","last_clean":"2024-04-16T12:55:16.369060+0000","last_became_active":"2024-04-16T12:55:09.606250+0000","last_became_peered":"2024-04-16T12:55:09.606250+0000","last_unstale":"2024-04-16T12:55:16.369060+0000","last_undegraded":"2024-04-16T12:55:16.369060+0000","last_fullsized":"2024-04-16T12:55:16.369060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633241+0000","last_change":"2024-04-16T12:55:08.609448+0000","last_active":"2024-04-16T12:55:14.633241+0000","last_peered":"2024-04-16T12:55:14.633241+0000","last_clean":"2024-04-16T12:55:14.633241+0000","last_became_active":"2024-04-16T12:55:08.609122+0000","last_became_peered":"2024-04-16T12:55:08.609122+0000","last_unstale":"2024-04-16T12:55:14.633241+0000","last_undegraded":"2024-04-16T12:55:14.633241+0000","last_fullsized":"2024-04-16T12:55:14.633241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369406+0000","last_change":"2024-04-16T12:55:13.644519+0000","last_active":"2024-04-16T12:55:16.369406+0000","last_peered":"2024-04-16T12:55:16.369406+0000","last_clean":"2024-04-16T12:55:16.369406+0000","last_became_active":"2024-04-16T12:55:13.644072+0000","last_became_peered":"2024-04-16T12:55:13.644072+0000","last_unstale":"2024-04-16T12:55:16.369406+0000","last_undegraded":"2024-04-16T12:55:16.369406+0000","last_fullsized":"2024-04-16T12:55:16.369406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367454+0000","last_change":"2024-04-16T12:55:09.599598+0000","last_active":"2024-04-16T12:55:16.367454+0000","last_peered":"2024-04-16T12:55:16.367454+0000","last_clean":"2024-04-16T12:55:16.367454+0000","last_became_active":"2024-04-16T12:55:09.599115+0000","last_became_peered":"2024-04-16T12:55:09.599115+0000","last_unstale":"2024-04-16T12:55:16.367454+0000","last_undegraded":"2024-04-16T12:55:16.367454+0000","last_fullsized":"2024-04-16T12:55:16.367454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633947+0000","last_change":"2024-04-16T12:55:08.607221+0000","last_active":"2024-04-16T12:55:14.633947+0000","last_peered":"2024-04-16T12:55:14.633947+0000","last_clean":"2024-04-16T12:55:14.633947+0000","last_became_active":"2024-04-16T12:55:08.606654+0000","last_became_peered":"2024-04-16T12:55:08.606654+0000","last_unstale":"2024-04-16T12:55:14.633947+0000","last_undegraded":"2024-04-16T12:55:14.633947+0000","last_fullsized":"2024-04-16T12:55:14.633947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694767+0000","last_change":"2024-04-16T12:55:13.638453+0000","last_active":"2024-04-16T12:55:14.694767+0000","last_peered":"2024-04-16T12:55:14.694767+0000","last_clean":"2024-04-16T12:55:14.694767+0000","last_became_active":"2024-04-16T12:55:13.637979+0000","last_became_peered":"2024-04-16T12:55:13.637979+0000","last_unstale":"2024-04-16T12:55:14.694767+0000","last_undegraded":"2024-04-16T12:55:14.694767+0000","last_fullsized":"2024-04-16T12:55:14.694767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:03:31.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633869+0000","last_change":"2024-04-16T12:55:09.608895+0000","last_active":"2024-04-16T12:55:14.633869+0000","last_peered":"2024-04-16T12:55:14.633869+0000","last_clean":"2024-04-16T12:55:14.633869+0000","last_became_active":"2024-04-16T12:55:09.608614+0000","last_became_peered":"2024-04-16T12:55:09.608614+0000","last_unstale":"2024-04-16T12:55:14.633869+0000","last_undegraded":"2024-04-16T12:55:14.633869+0000","last_fullsized":"2024-04-16T12:55:14.633869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369378+0000","last_change":"2024-04-16T12:55:08.609382+0000","last_active":"2024-04-16T12:55:16.369378+0000","last_peered":"2024-04-16T12:55:16.369378+0000","last_clean":"2024-04-16T12:55:16.369378+0000","last_became_active":"2024-04-16T12:55:08.609119+0000","last_became_peered":"2024-04-16T12:55:08.609119+0000","last_unstale":"2024-04-16T12:55:16.369378+0000","last_undegraded":"2024-04-16T12:55:16.369378+0000","last_fullsized":"2024-04-16T12:55:16.369378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694727+0000","last_change":"2024-04-16T12:55:13.983697+0000","last_active":"2024-04-16T12:55:14.694727+0000","last_peered":"2024-04-16T12:55:14.694727+0000","last_clean":"2024-04-16T12:55:14.694727+0000","last_became_active":"2024-04-16T12:55:13.983341+0000","last_became_peered":"2024-04-16T12:55:13.983341+0000","last_unstale":"2024-04-16T12:55:14.694727+0000","last_undegraded":"2024-04-16T12:55:14.694727+0000","last_fullsized":"2024-04-16T12:55:14.694727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367175+0000","last_change":"2024-04-16T12:55:13.982783+0000","last_active":"2024-04-16T12:55:16.367175+0000","last_peered":"2024-04-16T12:55:16.367175+0000","last_clean":"2024-04-16T12:55:16.367175+0000","last_became_active":"2024-04-16T12:55:13.982410+0000","last_became_peered":"2024-04-16T12:55:13.982410+0000","last_unstale":"2024-04-16T12:55:16.367175+0000","last_undegraded":"2024-04-16T12:55:16.367175+0000","last_fullsized":"2024-04-16T12:55:16.367175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632676+0000","last_change":"2024-04-16T12:55:09.613731+0000","last_active":"2024-04-16T12:55:14.632676+0000","last_peered":"2024-04-16T12:55:14.632676+0000","last_clean":"2024-04-16T12:55:14.632676+0000","last_became_active":"2024-04-16T12:55:09.613019+0000","last_became_peered":"2024-04-16T12:55:09.613019+0000","last_unstale":"2024-04-16T12:55:14.632676+0000","last_undegraded":"2024-04-16T12:55:14.632676+0000","last_fullsized":"2024-04-16T12:55:14.632676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633344+0000","last_change":"2024-04-16T12:55:08.607825+0000","last_active":"2024-04-16T12:55:14.633344+0000","last_peered":"2024-04-16T12:55:14.633344+0000","last_clean":"2024-04-16T12:55:14.633344+0000","last_became_active":"2024-04-16T12:55:08.607513+0000","last_became_peered":"2024-04-16T12:55:08.607513+0000","last_unstale":"2024-04-16T12:55:14.633344+0000","last_undegraded":"2024-04-16T12:55:14.633344+0000","last_fullsized":"2024-04-16T12:55:14.633344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369166+0000","last_change":"2024-04-16T12:55:13.648936+0000","last_active":"2024-04-16T12:55:16.369166+0000","last_peered":"2024-04-16T12:55:16.369166+0000","last_clean":"2024-04-16T12:55:16.369166+0000","last_became_active":"2024-04-16T12:55:13.648492+0000","last_became_peered":"2024-04-16T12:55:13.648492+0000","last_unstale":"2024-04-16T12:55:16.369166+0000","last_undegraded":"2024-04-16T12:55:16.369166+0000","last_fullsized":"2024-04-16T12:55:16.369166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694761+0000","last_change":"2024-04-16T12:55:09.613188+0000","last_active":"2024-04-16T12:55:14.694761+0000","last_peered":"2024-04-16T12:55:14.694761+0000","last_clean":"2024-04-16T12:55:14.694761+0000","last_became_active":"2024-04-16T12:55:09.612860+0000","last_became_peered":"2024-04-16T12:55:09.612860+0000","last_unstale":"2024-04-16T12:55:14.694761+0000","last_undegraded":"2024-04-16T12:55:14.694761+0000","last_fullsized":"2024-04-16T12:55:14.694761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694941+0000","last_change":"2024-04-16T12:55:08.603901+0000","last_active":"2024-04-16T12:55:14.694941+0000","last_peered":"2024-04-16T12:55:14.694941+0000","last_clean":"2024-04-16T12:55:14.694941+0000","last_became_active":"2024-04-16T12:55:08.603600+0000","last_became_peered":"2024-04-16T12:55:08.603600+0000","last_unstale":"2024-04-16T12:55:14.694941+0000","last_undegraded":"2024-04-16T12:55:14.694941+0000","last_fullsized":"2024-04-16T12:55:14.694941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368157+0000","last_change":"2024-04-16T12:55:08.603403+0000","last_active":"2024-04-16T12:55:16.368157+0000","last_peered":"2024-04-16T12:55:16.368157+0000","last_clean":"2024-04-16T12:55:16.368157+0000","last_became_active":"2024-04-16T12:55:08.603126+0000","last_became_peered":"2024-04-16T12:55:08.603126+0000","last_unstale":"2024-04-16T12:55:16.368157+0000","last_undegraded":"2024-04-16T12:55:16.368157+0000","last_fullsized":"2024-04-16T12:55:16.368157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367337+0000","last_change":"2024-04-16T12:55:09.599833+0000","last_active":"2024-04-16T12:55:16.367337+0000","last_peered":"2024-04-16T12:55:16.367337+0000","last_clean":"2024-04-16T12:55:16.367337+0000","last_became_active":"2024-04-16T12:55:09.599149+0000","last_became_peered":"2024-04-16T12:55:09.599149+0000","last_unstale":"2024-04-16T12:55:16.367337+0000","last_undegraded":"2024-04-16T12:55:16.367337+0000","last_fullsized":"2024-04-16T12:55:16.367337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631664+0000","last_change":"2024-04-16T12:55:13.650199+0000","last_active":"2024-04-16T12:55:14.631664+0000","last_peered":"2024-04-16T12:55:14.631664+0000","last_clean":"2024-04-16T12:55:14.631664+0000","last_became_active":"2024-04-16T12:55:13.649637+0000","last_became_peered":"2024-04-16T12:55:13.649637+0000","last_unstale":"2024-04-16T12:55:14.631664+0000","last_undegraded":"2024-04-16T12:55:14.631664+0000","last_fullsized":"2024-04-16T12:55:14.631664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:31.305753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694949+0000","last_change":"2024-04-16T12:55:08.606921+0000","last_active":"2024-04-16T12:55:14.694949+0000","last_peered":"2024-04-16T12:55:14.694949+0000","last_clean":"2024-04-16T12:55:14.694949+0000","last_became_active":"2024-04-16T12:55:08.606543+0000","last_became_peered":"2024-04-16T12:55:08.606543+0000","last_unstale":"2024-04-16T12:55:14.694949+0000","last_undegraded":"2024-04-16T12:55:14.694949+0000","last_fullsized":"2024-04-16T12:55:14.694949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367882+0000","last_change":"2024-04-16T12:55:09.607307+0000","last_active":"2024-04-16T12:55:16.367882+0000","last_peered":"2024-04-16T12:55:16.367882+0000","last_clean":"2024-04-16T12:55:16.367882+0000","last_became_active":"2024-04-16T12:55:09.607019+0000","last_became_peered":"2024-04-16T12:55:09.607019+0000","last_unstale":"2024-04-16T12:55:16.367882+0000","last_undegraded":"2024-04-16T12:55:16.367882+0000","last_fullsized":"2024-04-16T12:55:16.367882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:02.600497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695264+0000","last_change":"2024-04-16T12:55:13.641212+0000","last_active":"2024-04-16T12:55:14.695264+0000","last_peered":"2024-04-16T12:55:14.695264+0000","last_clean":"2024-04-16T12:55:14.695264+0000","last_became_active":"2024-04-16T12:55:13.640805+0000","last_became_peered":"2024-04-16T12:55:13.640805+0000","last_unstale":"2024-04-16T12:55:14.695264+0000","last_undegraded":"2024-04-16T12:55:14.695264+0000","last_fullsized":"2024-04-16T12:55:14.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:17.726629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367396+0000","last_change":"2024-04-16T12:55:09.609579+0000","last_active":"2024-04-16T12:55:16.367396+0000","last_peered":"2024-04-16T12:55:16.367396+0000","last_clean":"2024-04-16T12:55:16.367396+0000","last_became_active":"2024-04-16T12:55:09.609318+0000","last_became_peered":"2024-04-16T12:55:09.609318+0000","last_unstale":"2024-04-16T12:55:16.367396+0000","last_undegraded":"2024-04-16T12:55:16.367396+0000","last_fullsized":"2024-04-16T12:55:16.367396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631556+0000","last_change":"2024-04-16T12:55:09.603666+0000","last_active":"2024-04-16T12:55:14.631556+0000","last_peered":"2024-04-16T12:55:14.631556+0000","last_clean":"2024-04-16T12:55:14.631556+0000","last_became_active":"2024-04-16T12:55:09.603143+0000","last_became_peered":"2024-04-16T12:55:09.603143+0000","last_unstale":"2024-04-16T12:55:14.631556+0000","last_undegraded":"2024-04-16T12:55:14.631556+0000","last_fullsized":"2024-04-16T12:55:14.631556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633935+0000","last_change":"2024-04-16T12:55:09.617882+0000","last_active":"2024-04-16T12:55:14.633935+0000","last_peered":"2024-04-16T12:55:14.633935+0000","last_clean":"2024-04-16T12:55:14.633935+0000","last_became_active":"2024-04-16T12:55:09.616769+0000","last_became_peered":"2024-04-16T12:55:09.616769+0000","last_unstale":"2024-04-16T12:55:14.633935+0000","last_undegraded":"2024-04-16T12:55:14.633935+0000","last_fullsized":"2024-04-16T12:55:14.633935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367223+0000","last_change":"2024-04-16T12:55:09.602044+0000","last_active":"2024-04-16T12:55:16.367223+0000","last_peered":"2024-04-16T12:55:16.367223+0000","last_clean":"2024-04-16T12:55:16.367223+0000","last_became_active":"2024-04-16T12:55:09.601747+0000","last_became_peered":"2024-04-16T12:55:09.601747+0000","last_unstale":"2024-04-16T12:55:16.367223+0000","last_undegraded":"2024-04-16T12:55:16.367223+0000","last_fullsized":"2024-04-16T12:55:16.367223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695371+0000","last_change":"2024-04-16T12:55:09.600028+0000","last_active":"2024-04-16T12:55:14.695371+0000","last_peered":"2024-04-16T12:55:14.695371+0000","last_clean":"2024-04-16T12:55:14.695371+0000","last_became_active":"2024-04-16T12:55:09.599747+0000","last_became_peered":"2024-04-16T12:55:09.599747+0000","last_unstale":"2024-04-16T12:55:14.695371+0000","last_undegraded":"2024-04-16T12:55:14.695371+0000","last_fullsized":"2024-04-16T12:55:14.695371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633104+0000","last_change":"2024-04-16T12:55:09.612581+0000","last_active":"2024-04-16T12:55:14.633104+0000","last_peered":"2024-04-16T12:55:14.633104+0000","last_clean":"2024-04-16T12:55:14.633104+0000","last_became_active":"2024-04-16T12:55:09.612244+0000","last_became_peered":"2024-04-16T12:55:09.612244+0000","last_unstale":"2024-04-16T12:55:14.633104+0000","last_undegraded":"2024-04-16T12:55:14.633104+0000","last_fullsized":"2024-04-16T12:55:14.633104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369155+0000","last_change":"2024-04-16T12:55:09.611077+0000","last_active":"2024-04-16T12:55:16.369155+0000","last_peered":"2024-04-16T12:55:16.369155+0000","last_clean":"2024-04-16T12:55:16.369155+0000","last_became_active":"2024-04-16T12:55:09.610542+0000","last_became_peered":"2024-04-16T12:55:09.610542+0000","last_unstale":"2024-04-16T12:55:16.369155+0000","last_undegraded":"2024-04-16T12:55:16.369155+0000","last_fullsized":"2024-04-16T12:55:16.369155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695447+0000","last_change":"2024-04-16T12:55:09.600725+0000","last_active":"2024-04-16T12:55:14.695447+0000","last_peered":"2024-04-16T12:55:14.695447+0000","last_clean":"2024-04-16T12:55:14.695447+0000","last_became_active":"2024-04-16T12:55:09.600418+0000","last_became_peered":"2024-04-16T12:55:09.600418+0000","last_unstale":"2024-04-16T12:55:14.695447+0000","last_undegraded":"2024-04-16T12:55:14.695447+0000","last_fullsized":"2024-04-16T12:55:14.695447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633340+0000","last_change":"2024-04-16T12:55:09.616346+0000","last_active":"2024-04-16T12:55:14.633340+0000","last_peered":"2024-04-16T12:55:14.633340+0000","last_clean":"2024-04-16T12:55:14.633340+0000","last_became_active":"2024-04-16T12:55:09.615328+0000","last_became_peered":"2024-04-16T12:55:09.615328+0000","last_unstale":"2024-04-16T12:55:14.633340+0000","last_undegraded":"2024-04-16T12:55:14.633340+0000","last_fullsized":"2024-04-16T12:55:14.633340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694859+0000","last_change":"2024-04-16T12:55:09.597852+0000","last_active":"2024-04-16T12:55:14.694859+0000","last_peered":"2024-04-16T12:55:14.694859+0000","last_clean":"2024-04-16T12:55:14.694859+0000","last_became_active":"2024-04-16T12:55:09.597466+0000","last_became_peered":"2024-04-16T12:55:09.597466+0000","last_unstale":"2024-04-16T12:55:14.694859+0000","last_undegraded":"2024-04-16T12:55:14.694859+0000","last_fullsized":"2024-04-16T12:55:14.694859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633627+0000","last_change":"2024-04-16T12:55:09.610381+0000","last_active":"2024-04-16T12:55:14.633627+0000","last_peered":"2024-04-16T12:55:14.633627+0000","last_clean":"2024-04-16T12:55:14.633627+0000","last_became_active":"2024-04-16T12:55:09.610124+0000","last_became_peered":"2024-04-16T12:55:09.610124+0000","last_unstale":"2024-04-16T12:55:14.633627+0000","last_undegraded":"2024-04-16T12:55:14.633627+0000","last_fullsized":"2024-04-16T12:55:14.633627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367062+0000","last_change":"2024-04-16T12:55:09.616215+0000","last_active":"2024-04-16T12:55:16.367062+0000","last_peered":"2024-04-16T12:55:16.367062+0000","last_clean":"2024-04-16T12:55:16.367062+0000","last_became_active":"2024-04-16T12:55:09.615568+0000","last_became_peered":"2024-04-16T12:55:09.615568+0000","last_unstale":"2024-04-16T12:55:16.367062+0000","last_undegraded":"2024-04-16T12:55:16.367062+0000","last_fullsized":"2024-04-16T12:55:16.367062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369286+0000","last_change":"2024-04-16T12:55:09.617828+0000","last_active":"2024-04-16T12:55:16.369286+0000","last_peered":"2024-04-16T12:55:16.369286+0000","last_clean":"2024-04-16T12:55:16.369286+0000","last_became_active":"2024-04-16T12:55:09.617544+0000","last_became_peered":"2024-04-16T12:55:09.617544+0000","last_unstale":"2024-04-16T12:55:16.369286+0000","last_undegraded":"2024-04-16T12:55:16.369286+0000","last_fullsized":"2024-04-16T12:55:16.369286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368942+0000","last_change":"2024-04-16T12:55:09.612315+0000","last_active":"2024-04-16T12:55:16.368942+0000","last_peered":"2024-04-16T12:55:16.368942+0000","last_clean":"2024-04-16T12:55:16.368942+0000","last_became_active":"2024-04-16T12:55:09.612023+0000","last_became_peered":"2024-04-16T12:55:09.612023+0000","last_unstale":"2024-04-16T12:55:16.368942+0000","last_undegraded":"2024-04-16T12:55:16.368942+0000","last_fullsized":"2024-04-16T12:55:16.368942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:26.067302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632023+0000","last_change":"2024-04-16T12:55:09.609432+0000","last_active":"2024-04-16T12:55:14.632023+0000","last_peered":"2024-04-16T12:55:14.632023+0000","last_clean":"2024-04-16T12:55:14.632023+0000","last_became_active":"2024-04-16T12:55:09.609172+0000","last_became_peered":"2024-04-16T12:55:09.609172+0000","last_unstale":"2024-04-16T12:55:14.632023+0000","last_undegraded":"2024-04-16T12:55:14.632023+0000","last_fullsized":"2024-04-16T12:55:14.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634287+0000","last_change":"2024-04-16T12:55:09.607797+0000","last_active":"2024-04-16T12:55:14.634287+0000","last_peered":"2024-04-16T12:55:14.634287+0000","last_clean":"2024-04-16T12:55:14.634287+0000","last_became_active":"2024-04-16T12:55:09.607546+0000","last_became_peered":"2024-04-16T12:55:09.607546+0000","last_unstale":"2024-04-16T12:55:14.634287+0000","last_undegraded":"2024-04-16T12:55:14.634287+0000","last_fullsized":"2024-04-16T12:55:14.634287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633202+0000","last_change":"2024-04-16T12:55:09.613594+0000","last_active":"2024-04-16T12:55:14.633202+0000","last_peered":"2024-04-16T12:55:14.633202+0000","last_clean":"2024-04-16T12:55:14.633202+0000","last_became_active":"2024-04-16T12:55:09.613296+0000","last_became_peered":"2024-04-16T12:55:09.613296+0000","last_unstale":"2024-04-16T12:55:14.633202+0000","last_undegraded":"2024-04-16T12:55:14.633202+0000","last_fullsized":"2024-04-16T12:55:14.633202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632804+0000","last_change":"2024-04-16T12:55:09.613823+0000","last_active":"2024-04-16T12:55:14.632804+0000","last_peered":"2024-04-16T12:55:14.632804+0000","last_clean":"2024-04-16T12:55:14.632804+0000","last_became_active":"2024-04-16T12:55:09.613460+0000","last_became_peered":"2024-04-16T12:55:09.613460+0000","last_unstale":"2024-04-16T12:55:14.632804+0000","last_undegraded":"2024-04-16T12:55:14.632804+0000","last_fullsized":"2024-04-16T12:55:14.632804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367104+0000","last_change":"2024-04-16T12:55:09.605119+0000","last_active":"2024-04-16T12:55:16.367104+0000","last_peered":"2024-04-16T12:55:16.367104+0000","last_clean":"2024-04-16T12:55:16.367104+0000","last_became_active":"2024-04-16T12:55:09.604862+0000","last_became_peered":"2024-04-16T12:55:09.604862+0000","last_unstale":"2024-04-16T12:55:16.367104+0000","last_undegraded":"2024-04-16T12:55:16.367104+0000","last_fullsized":"2024-04-16T12:55:16.367104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:09.316326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694754+0000","last_change":"2024-04-16T12:55:09.605111+0000","last_active":"2024-04-16T12:55:14.694754+0000","last_peered":"2024-04-16T12:55:14.694754+0000","last_clean":"2024-04-16T12:55:14.694754+0000","last_became_active":"2024-04-16T12:55:09.604719+0000","last_became_peered":"2024-04-16T12:55:09.604719+0000","last_unstale":"2024-04-16T12:55:14.694754+0000","last_undegraded":"2024-04-16T12:55:14.694754+0000","last_fullsized":"2024-04-16T12:55:14.694754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368708+0000","last_change":"2024-04-16T12:55:09.608920+0000","last_active":"2024-04-16T12:55:16.368708+0000","last_peered":"2024-04-16T12:55:16.368708+0000","last_clean":"2024-04-16T12:55:16.368708+0000","last_became_active":"2024-04-16T12:55:09.608627+0000","last_became_peered":"2024-04-16T12:55:09.608627+0000","last_unstale":"2024-04-16T12:55:16.368708+0000","last_undegraded":"2024-04-16T12:55:16.368708+0000","last_fullsized":"2024-04-16T12:55:16.368708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369071+0000","last_change":"2024-04-16T12:55:09.619322+0000","last_active":"2024-04-16T12:55:16.369071+0000","last_peered":"2024-04-16T12:55:16.369071+0000","last_clean":"2024-04-16T12:55:16.369071+0000","last_became_active":"2024-04-16T12:55:09.619043+0000","last_became_peered":"2024-04-16T12:55:09.619043+0000","last_unstale":"2024-04-16T12:55:16.369071+0000","last_undegraded":"2024-04-16T12:55:16.369071+0000","last_fullsized":"2024-04-16T12:55:16.369071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369041+0000","last_change":"2024-04-16T12:55:09.618675+0000","last_active":"2024-04-16T12:55:16.369041+0000","last_peered":"2024-04-16T12:55:16.369041+0000","last_clean":"2024-04-16T12:55:16.369041+0000","last_became_active":"2024-04-16T12:55:09.618346+0000","last_became_peered":"2024-04-16T12:55:09.618346+0000","last_unstale":"2024-04-16T12:55:16.369041+0000","last_undegraded":"2024-04-16T12:55:16.369041+0000","last_fullsized":"2024-04-16T12:55:16.369041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368488+0000","last_change":"2024-04-16T12:55:09.616435+0000","last_active":"2024-04-16T12:55:16.368488+0000","last_peered":"2024-04-16T12:55:16.368488+0000","last_clean":"2024-04-16T12:55:16.368488+0000","last_became_active":"2024-04-16T12:55:09.616054+0000","last_became_peered":"2024-04-16T12:55:09.616054+0000","last_unstale":"2024-04-16T12:55:16.368488+0000","last_undegraded":"2024-04-16T12:55:16.368488+0000","last_fullsized":"2024-04-16T12:55:16.368488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694651+0000","last_change":"2024-04-16T12:55:09.616193+0000","last_active":"2024-04-16T12:55:14.694651+0000","last_peered":"2024-04-16T12:55:14.694651+0000","last_clean":"2024-04-16T12:55:14.694651+0000","last_became_active":"2024-04-16T12:55:09.615114+0000","last_became_peered":"2024-04-16T12:55:09.615114+0000","last_unstale":"2024-04-16T12:55:14.694651+0000","last_undegraded":"2024-04-16T12:55:14.694651+0000","last_fullsized":"2024-04-16T12:55:14.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368221+0000","last_change":"2024-04-16T12:55:09.612626+0000","last_active":"2024-04-16T12:55:16.368221+0000","last_peered":"2024-04-16T12:55:16.368221+0000","last_clean":"2024-04-16T12:55:16.368221+0000","last_became_active":"2024-04-16T12:55:09.612338+0000","last_became_peered":"2024-04-16T12:55:09.612338+0000","last_unstale":"2024-04-16T12:55:16.368221+0000","last_undegraded":"2024-04-16T12:55:16.368221+0000","last_fullsized":"2024-04-16T12:55:16.368221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633547+0000","last_change":"2024-04-16T12:55:09.613314+0000","last_active":"2024-04-16T12:55:14.633547+0000","last_peered":"2024-04-16T12:55:14.633547+0000","last_clean":"2024-04-16T12:55:14.633547+0000","last_became_active":"2024-04-16T12:55:09.613047+0000","last_became_peered":"2024-04-16T12:55:09.613047+0000","last_unstale":"2024-04-16T12:55:14.633547+0000","last_undegraded":"2024-04-16T12:55:14.633547+0000","last_fullsized":"2024-04-16T12:55:14.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368254+0000","last_change":"2024-04-16T12:55:09.612821+0000","last_active":"2024-04-16T12:55:16.368254+0000","last_peered":"2024-04-16T12:55:16.368254+0000","last_clean":"2024-04-16T12:55:16.368254+0000","last_became_active":"2024-04-16T12:55:09.612537+0000","last_became_peered":"2024-04-16T12:55:09.612537+0000","last_unstale":"2024-04-16T12:55:16.368254+0000","last_undegraded":"2024-04-16T12:55:16.368254+0000","last_fullsized":"2024-04-16T12:55:16.368254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633793+0000","last_change":"2024-04-16T12:55:09.616023+0000","last_active":"2024-04-16T12:55:14.633793+0000","last_peered":"2024-04-16T12:55:14.633793+0000","last_clean":"2024-04-16T12:55:14.633793+0000","last_became_active":"2024-04-16T12:55:09.615631+0000","last_became_peered":"2024-04-16T12:55:09.615631+0000","last_unstale":"2024-04-16T12:55:14.633793+0000","last_undegraded":"2024-04-16T12:55:14.633793+0000","last_fullsized":"2024-04-16T12:55:14.633793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367139+0000","last_change":"2024-04-16T12:55:09.595574+0000","last_active":"2024-04-16T12:55:16.367139+0000","last_peered":"2024-04-16T12:55:16.367139+0000","last_clean":"2024-04-16T12:55:16.367139+0000","last_became_active":"2024-04-16T12:55:09.595237+0000","last_became_peered":"2024-04-16T12:55:09.595237+0000","last_unstale":"2024-04-16T12:55:16.367139+0000","last_undegraded":"2024-04-16T12:55:16.367139+0000","last_fullsized":"2024-04-16T12:55:16.367139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633687+0000","last_change":"2024-04-16T12:55:09.609132+0000","last_active":"2024-04-16T12:55:14.633687+0000","last_peered":"2024-04-16T12:55:14.633687+0000","last_clean":"2024-04-16T12:55:14.633687+0000","last_became_active":"2024-04-16T12:55:09.608733+0000","last_became_peered":"2024-04-16T12:55:09.608733+0000","last_unstale":"2024-04-16T12:55:14.633687+0000","last_undegraded":"2024-04-16T12:55:14.633687+0000","last_fullsized":"2024-04-16T12:55:14.633687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368365+0000","last_change":"2024-04-16T12:55:09.617426+0000","last_active":"2024-04-16T12:55:16.368365+0000","last_peered":"2024-04-16T12:55:16.368365+0000","last_clean":"2024-04-16T12:55:16.368365+0000","last_became_active":"2024-04-16T12:55:09.616828+0000","last_became_peered":"2024-04-16T12:55:09.616828+0000","last_unstale":"2024-04-16T12:55:16.368365+0000","last_undegraded":"2024-04-16T12:55:16.368365+0000","last_fullsized":"2024-04-16T12:55:16.368365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:01.823408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":690366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":99416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":690422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:55:33.057 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T12:55:33.058 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T12:55:33.058 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T12:55:33.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T12:55:33.059 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T12:55:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.194+0000 7f834fdba640 1 Processor -- start 2024-04-16T12:55:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 -- start start 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f834806c130 0x7f83480d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f83480b3a00 0x7f83480d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8348163480 con 0x7f834815ef70 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f834815f350 con 0x7f83480b3a00 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834fdba640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f83480d2470 con 0x7f834806c130 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834e357640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f83480b3a00 0x7f83480d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.195+0000 7f834db56640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f834815ef70 0x7f834806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34608/0 (socket says 172.21.15.18:34608) 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834db56640 1 -- 172.21.15.18:0/3771777131 learned_addr learned my addr 172.21.15.18:0/3771777131 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834d355640 1 --2- 172.21.15.18:0/3771777131 >> v2:172.21.15.104:3300/0 conn(0x7f834806c130 0x7f83480d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834e357640 1 -- 172.21.15.18:0/3771777131 >> v2:172.21.15.104:3300/0 conn(0x7f834806c130 msgr2=0x7f83480d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834e357640 1 --2- 172.21.15.18:0/3771777131 >> v2:172.21.15.104:3300/0 conn(0x7f834806c130 0x7f83480d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834e357640 1 -- 172.21.15.18:0/3771777131 >> v1:172.21.15.18:6789/0 conn(0x7f834815ef70 legacy=0x7f834806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834e357640 1 -- 172.21.15.18:0/3771777131 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8348163760 con 0x7f83480b3a00 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.196+0000 7f834cb54640 1 -- 172.21.15.18:0/3771777131 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360474816 0 0) 0x7f8348163480 con 0x7f834815ef70 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834e357640 1 --2- 172.21.15.18:0/3771777131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f83480d3400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83480d25f0 tx=0x7f834002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1b2056eb692d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834cb54640 1 -- 172.21.15.18:0/3771777131 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340039070 con 0x7f83480b3a00 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834cb54640 1 -- 172.21.15.18:0/3771777131 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834002cc60 con 0x7f83480b3a00 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834cb54640 1 -- 172.21.15.18:0/3771777131 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340034660 con 0x7f83480b3a00 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 -- 172.21.15.18:0/3771777131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 msgr2=0x7f83480d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 --2- 172.21.15.18:0/3771777131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f83480d3400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83480d25f0 tx=0x7f834002beb0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 -- 172.21.15.18:0/3771777131 shutdown_connections 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 --2- 172.21.15.18:0/3771777131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f83480d3400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 --2- 172.21.15.18:0/3771777131 >> v2:172.21.15.104:3300/0 conn(0x7f834806c130 0x7f83480d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 -- 172.21.15.18:0/3771777131 >> 172.21.15.18:0/3771777131 conn(0x7f83480b69e0 msgr2=0x7f83480d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 -- 172.21.15.18:0/3771777131 shutdown_connections 2024-04-16T12:55:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.197+0000 7f834fdba640 1 -- 172.21.15.18:0/3771777131 wait complete. 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 Processor -- start 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 -- start start 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f834806c130 0x7f83481e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 0x7f83480ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83480d5160 con 0x7f83480b3a00 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f83480d2a30 con 0x7f834806c130 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834fdba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f83480b34b0 con 0x7f834815ef70 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834d355640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834d355640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45546/0 (socket says 172.21.15.18:45546) 2024-04-16T12:55:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.199+0000 7f834d355640 1 -- 172.21.15.18:0/2111047761 learned_addr learned my addr 172.21.15.18:0/2111047761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834db56640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f834806c130 0x7f83481e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834e357640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 0x7f83480ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 -- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 msgr2=0x7f83480ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 0x7f83480ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 -- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f834806c130 msgr2=0x7f83481e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f834806c130 0x7f83481e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 -- 172.21.15.18:0/2111047761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83480c7dc0 con 0x7f83480b3a00 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834e357640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 0x7f83480ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834d355640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f833800d830 tx=0x7f833800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833800b6c0 con 0x7f83480b3a00 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338019070 con 0x7f83480b3a00 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83481e9e50 con 0x7f83480b3a00 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833800ba80 con 0x7f83480b3a00 2024-04-16T12:55:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.200+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83481ea410 con 0x7f83480b3a00 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.201+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83480752b0 con 0x7f83480b3a00 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.202+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f833801e460 con 0x7f83480b3a00 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.202+0000 7f833e7fc640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 0x7f832c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.202+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f833808c570 con 0x7f83480b3a00 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.202+0000 7f834db56640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 0x7f832c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.203+0000 7f834db56640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 0x7f832c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8344000f60 tx=0x7f8344007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.206+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f833805a660 con 0x7f83480b3a00 2024-04-16T12:55:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.441+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f83480d1100 con 0x7f83480b3a00 2024-04-16T12:55:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.444+0000 7f833e7fc640 1 -- 172.21.15.18:0/2111047761 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7f8338059f60 con 0x7f83480b3a00 2024-04-16T12:55:33.448 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:33.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 msgr2=0x7f832c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 0x7f832c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8344000f60 tx=0x7f8344007c00 comp rx=0 tx=0).stop 2024-04-16T12:55:33.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 msgr2=0x7f8348161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f833800d830 tx=0x7f833800dcf0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 shutdown_connections 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f832c06c8f0 0x7f832c06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f834815ef70 0x7f83480ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83480b3a00 0x7f8348161e50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 --2- 172.21.15.18:0/2111047761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f834806c130 0x7f83481e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 >> 172.21.15.18:0/2111047761 conn(0x7f83480b69e0 msgr2=0x7f83480b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 shutdown_connections 2024-04-16T12:55:33.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.447+0000 7f834fdba640 1 -- 172.21.15.18:0/2111047761 wait complete. 2024-04-16T12:55:33.460 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2461371258},{"type":"v1","addr":"172.21.15.104:6833","nonce":2461371258}]},"active_addr":"172.21.15.104:6833/2461371258","active_change":"2024-04-16T12:54:48.508015+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2337016797}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":325031639}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2120353228}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":3680481692}]}]} 2024-04-16T12:55:33.463 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T12:55:33.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T12:55:33.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:33.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.566+0000 7f86e84c8640 1 Processor -- start 2024-04-16T12:55:33.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.566+0000 7f86e84c8640 1 -- start start 2024-04-16T12:55:33.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.567+0000 7f86e84c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86e006c130 0x7f86e00d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.567+0000 7f86e84c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f86e00b3a00 0x7f86e00d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.567+0000 7f86e84c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e0163480 con 0x7f86e015ef70 2024-04-16T12:55:33.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.567+0000 7f86e84c8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f86e015f350 con 0x7f86e006c130 2024-04-16T12:55:33.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.567+0000 7f86e84c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f86e00d2470 con 0x7f86e00b3a00 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5a63640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86e006c130 0x7f86e00d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e6264640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f86e015ef70 0x7f86e006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36998/0 (socket says 172.21.15.18:36998) 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e6264640 1 -- 172.21.15.18:0/4096549298 learned_addr learned my addr 172.21.15.18:0/4096549298 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e6a65640 1 --2- 172.21.15.18:0/4096549298 >> v2:172.21.15.104:3300/0 conn(0x7f86e00b3a00 0x7f86e00d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5a63640 1 -- 172.21.15.18:0/4096549298 >> v2:172.21.15.104:3300/0 conn(0x7f86e00b3a00 msgr2=0x7f86e00d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5a63640 1 --2- 172.21.15.18:0/4096549298 >> v2:172.21.15.104:3300/0 conn(0x7f86e00b3a00 0x7f86e00d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5a63640 1 -- 172.21.15.18:0/4096549298 >> v1:172.21.15.18:6789/0 conn(0x7f86e015ef70 legacy=0x7f86e006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5262640 1 -- 172.21.15.18:0/4096549298 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100135751 0 0) 0x7f86e0163480 con 0x7f86e015ef70 2024-04-16T12:55:33.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.568+0000 7f86e5a63640 1 -- 172.21.15.18:0/4096549298 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e0163760 con 0x7f86e006c130 2024-04-16T12:55:33.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e5a63640 1 --2- 172.21.15.18:0/4096549298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e006c130 0x7f86e00d2ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d25f0 tx=0x7f86d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d31cdd42cd0d1c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e5262640 1 -- 172.21.15.18:0/4096549298 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0035020 con 0x7f86e006c130 2024-04-16T12:55:33.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e5262640 1 -- 172.21.15.18:0/4096549298 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d0031830 con 0x7f86e006c130 2024-04-16T12:55:33.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e5262640 1 -- 172.21.15.18:0/4096549298 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0031c00 con 0x7f86e006c130 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 -- 172.21.15.18:0/4096549298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e006c130 msgr2=0x7f86e00d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 --2- 172.21.15.18:0/4096549298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e006c130 0x7f86e00d2ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d25f0 tx=0x7f86d002b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 -- 172.21.15.18:0/4096549298 shutdown_connections 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 --2- 172.21.15.18:0/4096549298 >> v2:172.21.15.104:3300/0 conn(0x7f86e00b3a00 0x7f86e00d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 --2- 172.21.15.18:0/4096549298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e006c130 0x7f86e00d2ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.569+0000 7f86e84c8640 1 -- 172.21.15.18:0/4096549298 >> 172.21.15.18:0/4096549298 conn(0x7f86e00b69e0 msgr2=0x7f86e00d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.570+0000 7f86e84c8640 1 -- 172.21.15.18:0/4096549298 shutdown_connections 2024-04-16T12:55:33.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.570+0000 7f86e84c8640 1 -- 172.21.15.18:0/4096549298 wait complete. 2024-04-16T12:55:33.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.571+0000 7f86e84c8640 1 Processor -- start 2024-04-16T12:55:33.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.571+0000 7f86e84c8640 1 -- start start 2024-04-16T12:55:33.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.571+0000 7f86e84c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 0x7f86e0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.571+0000 7f86e84c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.571+0000 7f86e84c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 0x7f86e01f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e84c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00d5160 con 0x7f86e00b3a00 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e84c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00d2a30 con 0x7f86e006c130 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e84c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f86e00b34b0 con 0x7f86e015ef70 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38786/0 (socket says 172.21.15.18:38786) 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 -- 172.21.15.18:0/2439247906 learned_addr learned my addr 172.21.15.18:0/2439247906 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e6264640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 0x7f86e0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e6a65640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 0x7f86e01f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 -- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 msgr2=0x7f86e01f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 0x7f86e01f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 -- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 msgr2=0x7f86e0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 0x7f86e0157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 -- 172.21.15.18:0/2439247906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e01583b0 con 0x7f86e00b3a00 2024-04-16T12:55:33.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e6264640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 0x7f86e0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e6a65640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 0x7f86e01f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e5a63640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009860 tx=0x7f86d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0041070 con 0x7f86e00b3a00 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d003aa30 con 0x7f86e00b3a00 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e0157e60 con 0x7f86e00b3a00 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0035040 con 0x7f86e00b3a00 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.572+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e0158df0 con 0x7f86e00b3a00 2024-04-16T12:55:33.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.573+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e00752b0 con 0x7f86e00b3a00 2024-04-16T12:55:33.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.574+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86d0038020 con 0x7f86e00b3a00 2024-04-16T12:55:33.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.574+0000 7f86d6ffd640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 0x7f86c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.574+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f86d00ad9f0 con 0x7f86e00b3a00 2024-04-16T12:55:33.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.574+0000 7f86e6264640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 0x7f86c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.575+0000 7f86e6264640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 0x7f86c406edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000f60 tx=0x7f86dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.578+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86d007ba50 con 0x7f86e00b3a00 2024-04-16T12:55:33.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.769+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86e00d1100 con 0x7f86e00b3a00 2024-04-16T12:55:33.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.770+0000 7f86d6ffd640 1 -- 172.21.15.18:0/2439247906 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f86d007b350 con 0x7f86e00b3a00 2024-04-16T12:55:33.772 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:33.772 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:33.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 msgr2=0x7f86c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 0x7f86c406edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000f60 tx=0x7f86dc009040 comp rx=0 tx=0).stop 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 msgr2=0x7f86e00c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009860 tx=0x7f86d00046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 shutdown_connections 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f86c406c8f0 0x7f86c406edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f86e015ef70 0x7f86e01f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e00b3a00 0x7f86e00c9d00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 --2- 172.21.15.18:0/2439247906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86e006c130 0x7f86e0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 >> 172.21.15.18:0/2439247906 conn(0x7f86e00b69e0 msgr2=0x7f86e00b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 shutdown_connections 2024-04-16T12:55:33.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.772+0000 7f86e84c8640 1 -- 172.21.15.18:0/2439247906 wait complete. 2024-04-16T12:55:33.785 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T12:55:33.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:33.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.888+0000 7f2b6a71c640 1 Processor -- start 2024-04-16T12:55:33.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.888+0000 7f2b6a71c640 1 -- start start 2024-04-16T12:55:33.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b6a71c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2b6409b120 0x7f2b6409b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b6a71c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b64070e10 con 0x7f2b640d1740 2024-04-16T12:55:33.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b6a71c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b640d21a0 con 0x7f2b64071400 2024-04-16T12:55:33.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b6a71c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2b640d2480 con 0x7f2b6409b120 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b63fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2b640d1740 0x7f2b640d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37008/0 (socket says 172.21.15.18:37008) 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.889+0000 7f2b63fff640 1 -- 172.21.15.18:0/2256030588 learned_addr learned my addr 172.21.15.18:0/2256030588 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b68cb9640 1 --2- 172.21.15.18:0/2256030588 >> v2:172.21.15.104:3300/0 conn(0x7f2b6409b120 0x7f2b6409b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238271907 0 0) 0x7f2b64070e10 con 0x7f2b640d1740 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b50003520 con 0x7f2b640d1740 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2912023334 0 0) 0x7f2b640d21a0 con 0x7f2b64071400 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b64070e10 con 0x7f2b64071400 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b68cb9640 1 -- 172.21.15.18:0/2256030588 >> v1:172.21.15.104:6789/0 conn(0x7f2b64071400 legacy=0x7f2b6409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b68cb9640 1 -- 172.21.15.18:0/2256030588 >> v1:172.21.15.18:6789/0 conn(0x7f2b640d1740 legacy=0x7f2b640d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.890+0000 7f2b68cb9640 1 -- 172.21.15.18:0/2256030588 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640710b0 con 0x7f2b6409b120 2024-04-16T12:55:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b68cb9640 1 --2- 172.21.15.18:0/2256030588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6409b120 0x7f2b6409b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009d90 tx=0x7f2b5c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32412b37e02ab74 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c039070 con 0x7f2b6409b120 2024-04-16T12:55:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c02cd00 con 0x7f2b6409b120 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b637fe640 1 -- 172.21.15.18:0/2256030588 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c034660 con 0x7f2b6409b120 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b6a71c640 1 -- 172.21.15.18:0/2256030588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6409b120 msgr2=0x7f2b6409b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.891+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/2256030588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6409b120 0x7f2b6409b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009d90 tx=0x7f2b5c02bf50 comp rx=0 tx=0).stop 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.892+0000 7f2b6a71c640 1 -- 172.21.15.18:0/2256030588 shutdown_connections 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.892+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/2256030588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6409b120 0x7f2b6409b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.892+0000 7f2b6a71c640 1 -- 172.21.15.18:0/2256030588 >> 172.21.15.18:0/2256030588 conn(0x7f2b640d2600 msgr2=0x7f2b640d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.892+0000 7f2b6a71c640 1 -- 172.21.15.18:0/2256030588 shutdown_connections 2024-04-16T12:55:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.892+0000 7f2b6a71c640 1 -- 172.21.15.18:0/2256030588 wait complete. 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 Processor -- start 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 -- start start 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b64071400 0x7f2b6415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2b6409b120 0x7f2b6414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640d1b20 con 0x7f2b640d1740 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640720c0 con 0x7f2b64071400 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.893+0000 7f2b6a71c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6406d050 con 0x7f2b6409b120 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38796/0 (socket says 172.21.15.18:38796) 2024-04-16T12:55:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 -- 172.21.15.18:0/4281031054 learned_addr learned my addr 172.21.15.18:0/4281031054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b63fff640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b64071400 0x7f2b6415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b5bfff640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2b6409b120 0x7f2b6414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 -- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2b6409b120 msgr2=0x7f2b6414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2b6409b120 0x7f2b6414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 -- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b64071400 msgr2=0x7f2b6415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b64071400 0x7f2b6415b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 -- 172.21.15.18:0/4281031054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640b6680 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b68cb9640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009eb0 tx=0x7f2b5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c039050 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c045070 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b640c6060 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c009450 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.894+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b640c6900 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.895+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b640c6450 con 0x7f2b640d1740 2024-04-16T12:55:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.896+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b5c03e850 con 0x7f2b640d1740 2024-04-16T12:55:33.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.896+0000 7f2b617fa640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 0x7f2b4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:33.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.896+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b5c0aea10 con 0x7f2b640d1740 2024-04-16T12:55:33.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.896+0000 7f2b63fff640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 0x7f2b4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:33.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.897+0000 7f2b63fff640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 0x7f2b4406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b54000f60 tx=0x7f2b54007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:33.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:33.901+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b5c07c5d0 con 0x7f2b640d1740 2024-04-16T12:55:34.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.086+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b640752b0 con 0x7f2b640d1740 2024-04-16T12:55:34.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.088+0000 7f2b617fa640 1 -- 172.21.15.18:0/4281031054 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f2b5c0808d0 con 0x7f2b640d1740 2024-04-16T12:55:34.089 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:34.089 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:34.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.089+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 msgr2=0x7f2b4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.089+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 0x7f2b4406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b54000f60 tx=0x7f2b54007d70 comp rx=0 tx=0).stop 2024-04-16T12:55:34.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.089+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 msgr2=0x7f2b640b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.089+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009eb0 tx=0x7f2b5c004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 shutdown_connections 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2b4406c8f0 0x7f2b4406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b640d1740 0x7f2b640b5c30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2b6409b120 0x7f2b6414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 --2- 172.21.15.18:0/4281031054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b64071400 0x7f2b6415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 >> 172.21.15.18:0/4281031054 conn(0x7f2b640d2600 msgr2=0x7f2b640aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 shutdown_connections 2024-04-16T12:55:34.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.090+0000 7f2b6a71c640 1 -- 172.21.15.18:0/4281031054 wait complete. 2024-04-16T12:55:34.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T12:55:34.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T12:55:34.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T12:55:34.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T12:55:34.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T12:55:34.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T12:55:34.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T12:55:34.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T12:55:34.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.281+0000 7f27744c5640 1 Processor -- start 2024-04-16T12:55:34.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.281+0000 7fe8d0dc0640 1 Processor -- start 2024-04-16T12:55:34.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.281+0000 7f27744c5640 1 -- start start 2024-04-16T12:55:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.282+0000 7fe8d0dc0640 1 -- start start 2024-04-16T12:55:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f27744c5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 0x7f276c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f27744c5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f276c0b69c0 0x7f276c0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f27744c5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c0b7320 con 0x7f276c1662b0 2024-04-16T12:55:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f27744c5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f276c163b80 con 0x7f276c164560 2024-04-16T12:55:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f27744c5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f276c163e60 con 0x7f276c0b69c0 2024-04-16T12:55:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f2771a60640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 0x7f276c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f2771a60640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 0x7f276c0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38810/0 (socket says 172.21.15.18:38810) 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8d0dc0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 0x7fe8c404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8d0dc0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8c404ffd0 0x7fe8c4037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8d0dc0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c4053720 con 0x7fe8c4038110 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8d0dc0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c4054330 con 0x7fe8c40ead00 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8d0dc0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c4053a00 con 0x7fe8c404ffd0 2024-04-16T12:55:34.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.283+0000 7f2771a60640 1 -- 172.21.15.18:0/4283928281 learned_addr learned my addr 172.21.15.18:0/4283928281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8caffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8c404ffd0 0x7fe8c4037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8caffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8c404ffd0 0x7fe8c4037bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:54928/0 (socket says 172.21.15.18:54928) 2024-04-16T12:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8caffd640 1 -- 172.21.15.18:0/2066858650 learned_addr learned my addr 172.21.15.18:0/2066858650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f2772a62640 1 --2- 172.21.15.18:0/4283928281 >> v2:172.21.15.104:3300/0 conn(0x7f276c0b69c0 0x7f276c0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966563754 0 0) 0x7f276c0b7320 con 0x7f276c1662b0 2024-04-16T12:55:34.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8caffd640 1 -- 172.21.15.18:0/2066858650 >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 msgr2=0x7fe8c404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7fe8cb7fe640 1 --2- 172.21.15.18:0/2066858650 >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 0x7fe8c404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2758003520 con 0x7f276c1662b0 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 <== mon.1 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374985147 0 0) 0x7f2758003520 con 0x7f276c1662b0 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 >> v2:172.21.15.104:3300/0 conn(0x7f276c0b69c0 msgr2=0x7f276c0b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 --2- 172.21.15.18:0/4283928281 >> v2:172.21.15.104:3300/0 conn(0x7f276c0b69c0 0x7f276c0b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.284+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 msgr2=0x7f276c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f7bbbfff640 1 Processor -- start 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 --2- 172.21.15.18:0/4283928281 >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 0x7f276c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c164140 con 0x7f276c1662b0 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 <== mon.1 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f27640019f0 con 0x7f276c1662b0 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 >> v1:172.21.15.104:6789/0 conn(0x7f276c1662b0 legacy=0x7f276c163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 0x7f2758003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2758004800 0x7f2758004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580051c0 0x7f275800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f7bbbfff640 1 -- start start 2024-04-16T12:55:34.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7fa133a8f640 1 Processor -- start 2024-04-16T12:55:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7fe8caffd640 1 --2- 172.21.15.18:0/2066858650 >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 0x7fe8c404fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7fe8caffd640 1 -- 172.21.15.18:0/2066858650 >> v1:172.21.15.104:6789/0 conn(0x7fe8c4038110 legacy=0x7fe8c4038580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:55:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7fe8caffd640 1 -- 172.21.15.18:0/2066858650 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c4053ce0 con 0x7fe8c404ffd0 2024-04-16T12:55:34.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f2772261640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 0x7f2758003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7fe8caffd640 1 --2- 172.21.15.18:0/2066858650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4037bd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4036560 tx=0x7fe8b802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899c007a9b5a324 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7fe8cb7fe640 1 --2- 172.21.15.18:0/2066858650 >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 0x7fe8c404fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7fe8ca7fc640 1 -- 172.21.15.18:0/2066858650 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8035020 con 0x7fe8c404ffd0 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f276c163b80 con 0x7f27580051c0 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f276c163e60 con 0x7f2758004800 2024-04-16T12:55:34.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f275800c060 con 0x7f2758003a00 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7fe8ca7fc640 1 -- 172.21.15.18:0/2066858650 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8031890 con 0x7fe8c404ffd0 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2771a60640 1 --2- 172.21.15.18:0/4283928281 >> v2:172.21.15.18:3300/0 conn(0x7f276c164560 0x7f276c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772261640 1 -- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2758004800 msgr2=0x7f2758004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772261640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2758004800 0x7f2758004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772261640 1 -- 172.21.15.18:0/4283928281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580051c0 msgr2=0x7f275800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772a62640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580051c0 0x7f275800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb403b020 0x7f7bb4033dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbbfff640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb4032d20 con 0x7f7bb4008d10 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbbfff640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb4033000 con 0x7f7bb4008930 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbbfff640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb4033930 con 0x7f7bb403b020 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb403b020 0x7f7bb4033dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb403b020 0x7f7bb4033dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:54948/0 (socket says 172.21.15.18:54948) 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbb7fe640 1 -- 172.21.15.18:0/3424163888 learned_addr learned my addr 172.21.15.18:0/3424163888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f7bbaffd640 1 --1- 172.21.15.18:0/3424163888 >> v1:172.21.15.104:6789/0 conn(0x7f7bb4008930 0x7f7bb4006aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:53226/0 (socket says 172.21.15.18:53226) 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/2066858650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c404ffd0 msgr2=0x7fe8c4037bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fe8d0dc0640 1 --2- 172.21.15.18:0/2066858650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4037bd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4036560 tx=0x7fe8b802b930 comp rx=0 tx=0).stop 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f791d2ba640 1 Processor -- start 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.285+0000 7f791d2ba640 1 -- start start 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f791d2ba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 0x7f791004fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f791d2ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f791003a0d0 0x7f791003a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f79177fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f791003a0d0 0x7f791003a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f79177fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f791003a0d0 0x7f791003a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38836/0 (socket says 172.21.15.18:38836) 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f79177fe640 1 -- 172.21.15.18:0/1995309981 learned_addr learned my addr 172.21.15.18:0/1995309981 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791003aa20 con 0x7f79100df830 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f79100561b0 con 0x7f791003a0d0 2024-04-16T12:55:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7910006c60 con 0x7f7910055d40 2024-04-16T12:55:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f79167fc640 1 --2- 172.21.15.18:0/1995309981 >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 0x7f791004fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772261640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580051c0 0x7f275800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7f2772261640 1 -- 172.21.15.18:0/4283928281 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2758003520 con 0x7f2758003a00 2024-04-16T12:55:34.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f2772a62640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580051c0 0x7f275800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:34.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f2772a62640 1 -- 172.21.15.18:0/4283928281 reap_dead start 2024-04-16T12:55:34.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.286+0000 7fa133a8f640 1 -- start start 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fa133a8f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa12c0cfb00 0x7fa12c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fa133a8f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12c1630c0 con 0x7fa12c162ce0 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fa133a8f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12c06f170 con 0x7fa12c0b4560 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fa133a8f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa12c06f450 con 0x7fa12c0cfb00 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7fa13102a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa12c0cfb00 0x7fa12c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f2772261640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 0x7f2758003e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f276400c4c0 tx=0x7f2758005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34473a4e0f6d7d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f7bbb7fe640 1 -- 172.21.15.18:0/3424163888 >> v1:172.21.15.104:6789/0 conn(0x7f7bb4008930 legacy=0x7f7bb4006aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f7bbb7fe640 1 -- 172.21.15.18:0/3424163888 >> v1:172.21.15.18:6789/0 conn(0x7f7bb4008d10 legacy=0x7f7bb403a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/2066858650 shutdown_connections 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 --2- 172.21.15.18:0/2066858650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4037bd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 --2- 172.21.15.18:0/2066858650 >> v2:172.21.15.18:3300/0 conn(0x7fe8c40ead00 0x7fe8c404fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/2066858650 >> 172.21.15.18:0/2066858650 conn(0x7fe8c4009fb0 msgr2=0x7fe8c400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/2066858650 shutdown_connections 2024-04-16T12:55:34.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/2066858650 wait complete. 2024-04-16T12:55:34.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fa13102a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa12c0cfb00 0x7fa12c0cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:54964/0 (socket says 172.21.15.18:54964) 2024-04-16T12:55:34.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fa13102a640 1 -- 172.21.15.18:0/1247135091 learned_addr learned my addr 172.21.15.18:0/1247135091 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f6e24f82640 1 Processor -- start 2024-04-16T12:55:34.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.287+0000 7f6e24f82640 1 -- start start 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f64d23d4640 1 Processor -- start 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e18037b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e1803a3d0 0x7f6e18104970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6e1803a830 0x7f6e18104eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6e18006590 con 0x7f6e1803a3d0 2024-04-16T12:55:34.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6e18038090 con 0x7f6e1803a830 2024-04-16T12:55:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e24f82640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6e18005f60 con 0x7f6e18039cf0 2024-04-16T12:55:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f7bbb7fe640 1 -- 172.21.15.18:0/3424163888 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb4055850 con 0x7f7bb403b020 2024-04-16T12:55:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f32c89c8640 1 Processor -- start 2024-04-16T12:55:34.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f79177fe640 1 -- 172.21.15.18:0/1995309981 >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 msgr2=0x7f791004fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f79177fe640 1 --2- 172.21.15.18:0/1995309981 >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 0x7f791004fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f79177fe640 1 -- 172.21.15.18:0/1995309981 >> v1:172.21.15.104:6789/0 conn(0x7f79100df830 legacy=0x7f79100366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f79177fe640 1 -- 172.21.15.18:0/1995309981 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7910006f40 con 0x7f791003a0d0 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f79167fc640 1 --2- 172.21.15.18:0/1995309981 >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 0x7f791004fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e1ed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6e1803a830 0x7f6e18104eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e1dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e1803a3d0 0x7f6e18104970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f32c89c8640 1 -- start start 2024-04-16T12:55:34.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f7bbb7fe640 1 --2- 172.21.15.18:0/3424163888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4033dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009870 tx=0x7f7bb002ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1b198573e884cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f79177fe640 1 --2- 172.21.15.18:0/1995309981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f791003a0d0 0x7f791003a4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f791806a180 tx=0x7f79180ab960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399c719b355c27d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7fe8d0dc0640 1 Processor -- start 2024-04-16T12:55:34.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e1dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e1803a3d0 0x7f6e18104970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38850/0 (socket says 172.21.15.18:38850) 2024-04-16T12:55:34.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f6e1dd9b640 1 -- 172.21.15.18:0/445385277 learned_addr learned my addr 172.21.15.18:0/445385277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7f64d23d4640 1 -- start start 2024-04-16T12:55:34.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f64d23d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f64c403aa90 0x7f64c4058ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f7bb9ffb640 1 -- 172.21.15.18:0/3424163888 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb002f870 con 0x7f7bb403b020 2024-04-16T12:55:34.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f7bb9ffb640 1 -- 172.21.15.18:0/3424163888 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb002fa10 con 0x7f7bb403b020 2024-04-16T12:55:34.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f7915ffb640 1 -- 172.21.15.18:0/1995309981 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180b4070 con 0x7f791003a0d0 2024-04-16T12:55:34.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64cb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f64c404cb60 0x7f64c403ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37028/0 (socket says 172.21.15.18:37028) 2024-04-16T12:55:34.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f7915ffb640 1 -- 172.21.15.18:0/1995309981 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79180b06d0 con 0x7f791003a0d0 2024-04-16T12:55:34.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f7915ffb640 1 -- 172.21.15.18:0/1995309981 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180b0b00 con 0x7f791003a0d0 2024-04-16T12:55:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764039070 con 0x7f2758003a00 2024-04-16T12:55:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.289+0000 7f277125f640 1 -- 172.21.15.18:0/4283928281 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276402cd00 con 0x7f2758003a00 2024-04-16T12:55:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f27744c5640 1 -- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 msgr2=0x7f2758003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f27744c5640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 0x7f2758003e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f276400c4c0 tx=0x7f2758005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64cb7fe640 1 -- 172.21.15.18:0/4246224589 learned_addr learned my addr 172.21.15.18:0/4246224589 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c4055890 con 0x7f64c404cb60 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c40ec000 con 0x7f64c40eb0f0 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f64c40eb540 con 0x7f64c403aa90 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452134613 0 0) 0x7fa12c1630c0 con 0x7fa12c162ce0 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f6e1dd9b640 1 -- 172.21.15.18:0/445385277 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 msgr2=0x7f6e18037b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:55:34.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/445385277 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e18037b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f6e1dd9b640 1 -- 172.21.15.18:0/445385277 >> v2:172.21.15.104:3300/0 conn(0x7f6e1803a830 msgr2=0x7f6e18104eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/445385277 >> v2:172.21.15.104:3300/0 conn(0x7f6e1803a830 0x7f6e18104eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f6e1dd9b640 1 -- 172.21.15.18:0/445385277 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e18054090 con 0x7f6e1803a3d0 2024-04-16T12:55:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981566680 0 0) 0x7f64c4055890 con 0x7f64c404cb60 2024-04-16T12:55:34.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.288+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa118003520 con 0x7fa12c162ce0 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 227544280 0 0) 0x7fa118003520 con 0x7fa12c162ce0 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 >> v2:172.21.15.104:3300/0 conn(0x7fa12c0cfb00 msgr2=0x7fa12c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 --2- 172.21.15.18:0/1247135091 >> v2:172.21.15.104:3300/0 conn(0x7fa12c0cfb00 0x7fa12c0cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 >> v1:172.21.15.104:6789/0 conn(0x7fa12c0b4560 legacy=0x7fa12c06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c06f730 con 0x7fa12c162ce0 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fa120001670 con 0x7fa12c162ce0 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 >> v1:172.21.15.18:6789/0 conn(0x7fa12c162ce0 legacy=0x7fa12c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180039b0 0x7fa118003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa118004800 0x7fa118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 0x7fa11800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c06f450 con 0x7fa118004800 2024-04-16T12:55:34.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa11800c040 con 0x7fa1180051c0 2024-04-16T12:55:34.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa11800c240 con 0x7fa1180039b0 2024-04-16T12:55:34.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c89c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32c4148470 0x7f32c406f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64bc003520 con 0x7f64c404cb60 2024-04-16T12:55:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 -- 172.21.15.18:0/3424163888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 msgr2=0x7f7bb4033dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 --2- 172.21.15.18:0/3424163888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4033dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009870 tx=0x7f7bb002ba50 comp rx=0 tx=0).stop 2024-04-16T12:55:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 -- 172.21.15.18:0/3424163888 shutdown_connections 2024-04-16T12:55:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/445385277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a3d0 0x7f6e18104970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e2006afa0 tx=0x7f6e20069900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb744a6db1b69b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c89c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f32c40afc50 0x7f32c41684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.290+0000 7fe8d0dc0640 1 -- start start 2024-04-16T12:55:34.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4038110 0x7fe8c4047150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4043680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8c40ead00 0x7fe8c404a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f791003a0d0 msgr2=0x7f791003a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 --2- 172.21.15.18:0/1995309981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f791003a0d0 0x7f791003a4e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f791806a180 tx=0x7f79180ab960 comp rx=0 tx=0).stop 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 shutdown_connections 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 --2- 172.21.15.18:0/1995309981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f791003a0d0 0x7f791003a4e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 --2- 172.21.15.18:0/1995309981 >> v2:172.21.15.104:3300/0 conn(0x7f7910055d40 0x7f791004fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 >> 172.21.15.18:0/1995309981 conn(0x7f791001e6f0 msgr2=0x7f7910055420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13182b640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180039b0 0x7fa118003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13102a640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa118004800 0x7fa118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c89c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c40ae9c0 con 0x7f32c40ad880 2024-04-16T12:55:34.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 0x7fa11800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267117212 0 0) 0x7f64c40ec000 con 0x7f64c40eb0f0 2024-04-16T12:55:34.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64c4055890 con 0x7f64c40eb0f0 2024-04-16T12:55:34.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1139376486 0 0) 0x7f64bc003520 con 0x7f64c404cb60 2024-04-16T12:55:34.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32bbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f32c40ad880 0x7f32c40af540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:53240/0 (socket says 172.21.15.18:53240) 2024-04-16T12:55:34.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32bbfff640 1 -- 172.21.15.18:0/4093078051 learned_addr learned my addr 172.21.15.18:0/4093078051 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:34.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40547c0 con 0x7fe8c404ffd0 2024-04-16T12:55:34.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 >> v2:172.21.15.104:3300/0 conn(0x7f64c403aa90 msgr2=0x7f64c4058ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:55:34.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 --2- 172.21.15.18:0/4246224589 >> v2:172.21.15.104:3300/0 conn(0x7f64c403aa90 0x7f64c4058ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 >> v1:172.21.15.104:6789/0 conn(0x7f64c40eb0f0 legacy=0x7f64c4057320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c40eb760 con 0x7f64c404cb60 2024-04-16T12:55:34.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c3fff640 1 --2- 172.21.15.18:0/4093078051 >> v2:172.21.15.104:3300/0 conn(0x7f32c40afc50 0x7f32c41684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c37fe640 1 --2- 172.21.15.18:0/4093078051 >> v2:172.21.15.18:3300/0 conn(0x7f32c4148470 0x7f32c406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4038c90 con 0x7fe8c4038110 2024-04-16T12:55:34.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f32c4070700 con 0x7f32c4148470 2024-04-16T12:55:34.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 --2- 172.21.15.18:0/3424163888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4033dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 -- 172.21.15.18:0/3424163888 >> 172.21.15.18:0/3424163888 conn(0x7f7bb401ef30 msgr2=0x7f7bb4055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8d0dc0640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c4054940 con 0x7fe8c40ead00 2024-04-16T12:55:34.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f32c406f8c0 con 0x7f32c40afc50 2024-04-16T12:55:34.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f64b8001670 con 0x7f64c404cb60 2024-04-16T12:55:34.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 >> v1:172.21.15.18:6789/0 conn(0x7f64c404cb60 legacy=0x7f64c403ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f7bbbfff640 1 -- 172.21.15.18:0/3424163888 shutdown_connections 2024-04-16T12:55:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8cbfff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8c40ead00 0x7fe8c404a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 -- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180039b0 msgr2=0x7fa118003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180039b0 0x7fa118003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 -- 172.21.15.18:0/1247135091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa118004800 msgr2=0x7fa118004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839233389 0 0) 0x7f32c40ae9c0 con 0x7f32c40ad880 2024-04-16T12:55:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a4003520 con 0x7f32c40ad880 2024-04-16T12:55:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa118004800 0x7fa118004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fa13202c640 1 -- 172.21.15.18:0/1247135091 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c06f730 con 0x7fa1180051c0 2024-04-16T12:55:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f27744c5640 1 -- 172.21.15.18:0/4283928281 shutdown_connections 2024-04-16T12:55:34.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f27744c5640 1 --2- 172.21.15.18:0/4283928281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2758003a00 0x7f2758003e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f27744c5640 1 -- 172.21.15.18:0/4283928281 >> 172.21.15.18:0/4283928281 conn(0x7f276c0b62b0 msgr2=0x7f276c09aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 0x7f64bc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7f64caffd640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0037a0 0x7f64bc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64caffd640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004160 0x7f64bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40eb540 con 0x7f64bc004160 2024-04-16T12:55:34.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc00c0c0 con 0x7f64bc0037a0 2024-04-16T12:55:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f64bc00c2c0 con 0x7f64bc004ba0 2024-04-16T12:55:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f6e1d59a640 1 -- 172.21.15.18:0/445385277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200a1070 con 0x7f6e1803a3d0 2024-04-16T12:55:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cb7fe640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0037a0 0x7f64bc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f6e1d59a640 1 -- 172.21.15.18:0/445385277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2009bc20 con 0x7f6e1803a3d0 2024-04-16T12:55:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f27744c5640 1 -- 172.21.15.18:0/4283928281 shutdown_connections 2024-04-16T12:55:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 shutdown_connections 2024-04-16T12:55:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f791d2ba640 1 -- 172.21.15.18:0/1995309981 wait complete. 2024-04-16T12:55:34.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 0x7f64bc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.1 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3905446851 0 0) 0x7f32a4003520 con 0x7f32c40ad880 2024-04-16T12:55:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f6e1d59a640 1 -- 172.21.15.18:0/445385277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200a5600 con 0x7f6e1803a3d0 2024-04-16T12:55:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 >> v2:172.21.15.104:3300/0 conn(0x7f32c40afc50 msgr2=0x7f32c41684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f32c2ffd640 1 --2- 172.21.15.18:0/4093078051 >> v2:172.21.15.104:3300/0 conn(0x7f32c40afc50 0x7f32c41684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 >> v2:172.21.15.18:3300/0 conn(0x7f32c4148470 msgr2=0x7f32c406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f32c2ffd640 1 --2- 172.21.15.18:0/4093078051 >> v2:172.21.15.18:3300/0 conn(0x7f32c4148470 0x7f32c406f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8cbfff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8c40ead00 0x7fe8c404a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56562/0 (socket says 172.21.15.18:56562) 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.291+0000 7fe8cbfff640 1 -- 172.21.15.18:0/3551145043 learned_addr learned my addr 172.21.15.18:0/3551145043 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4043680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 -- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8c40ead00 msgr2=0x7fe8c404a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe8c40ead00 0x7fe8c404a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 -- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4038110 msgr2=0x7fe8c4047150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8c4038110 0x7fe8c4047150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7fe8caffd640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c4047690 con 0x7fe8c404ffd0 2024-04-16T12:55:34.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f27744c5640 1 -- 172.21.15.18:0/4283928281 wait complete. 2024-04-16T12:55:34.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 -- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0037a0 msgr2=0x7f64bc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0037a0 0x7f64bc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fa13202c640 1 -- 172.21.15.18:0/1247135091 reap_dead start 2024-04-16T12:55:34.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 -- 172.21.15.18:0/4246224589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004160 msgr2=0x7f64bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004160 0x7f64bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f7bbbfff640 1 -- 172.21.15.18:0/3424163888 wait complete. 2024-04-16T12:55:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 -- 172.21.15.18:0/445385277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a3d0 msgr2=0x7f6e18104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 --2- 172.21.15.18:0/445385277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a3d0 0x7f6e18104970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6e2006afa0 tx=0x7f6e20069900 comp rx=0 tx=0).stop 2024-04-16T12:55:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fe8caffd640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4043680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8033000 tx=0x7fe8b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.292+0000 7f64cbfff640 1 -- 172.21.15.18:0/4246224589 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc003520 con 0x7f64bc004ba0 2024-04-16T12:55:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fa13202c640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 0x7fa11800b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa124003d80 tx=0x7fa118005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7b91becb4da19a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 -- 172.21.15.18:0/445385277 shutdown_connections 2024-04-16T12:55:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 --2- 172.21.15.18:0/445385277 >> v2:172.21.15.104:3300/0 conn(0x7f6e1803a830 0x7f6e18104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 --2- 172.21.15.18:0/445385277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a3d0 0x7f6e18104970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 --2- 172.21.15.18:0/445385277 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e18037b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 -- 172.21.15.18:0/445385277 >> 172.21.15.18:0/445385277 conn(0x7f6e18009fe0 msgr2=0x7f6e1800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124003980 con 0x7fa1180051c0 2024-04-16T12:55:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fa130829640 1 -- 172.21.15.18:0/1247135091 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12402be50 con 0x7fa1180051c0 2024-04-16T12:55:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f7bbbfff640 1 Processor -- start 2024-04-16T12:55:34.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8035050 con 0x7fe8c404ffd0 2024-04-16T12:55:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 -- 172.21.15.18:0/445385277 shutdown_connections 2024-04-16T12:55:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f64d0971640 1 -- 172.21.15.18:0/4246224589 reap_dead start 2024-04-16T12:55:34.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7f6e24f82640 1 -- 172.21.15.18:0/445385277 wait complete. 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c406fb80 con 0x7f32c40ad880 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.1 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f32ac001670 con 0x7f32c40ad880 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c37fe640 1 --2- 172.21.15.18:0/4093078051 >> v2:172.21.15.18:3300/0 conn(0x7f32c4148470 0x7f32c406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 >> v1:172.21.15.104:6789/0 conn(0x7f32c40ad880 legacy=0x7f32c40af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32a40039b0 0x7f32a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a4004800 0x7f32a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 0x7f32a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f27744c5640 1 Processor -- start 2024-04-16T12:55:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f7bbbfff640 1 -- start start 2024-04-16T12:55:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c4044100 con 0x7fe8c404ffd0 2024-04-16T12:55:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.293+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c40446c0 con 0x7fe8c404ffd0 2024-04-16T12:55:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8003e50 con 0x7fe8c404ffd0 2024-04-16T12:55:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f791d2ba640 1 Processor -- start 2024-04-16T12:55:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7fa133a8f640 1 -- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 msgr2=0x7fa11800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7fa133a8f640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 0x7fa11800b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa124003d80 tx=0x7fa118005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4070700 con 0x7f32a40039b0 2024-04-16T12:55:34.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f32c406f8c0 con 0x7f32a4004800 2024-04-16T12:55:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f32a400bf30 con 0x7f32a40051c0 2024-04-16T12:55:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f791d2ba640 1 -- start start 2024-04-16T12:55:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.294+0000 7f27744c5640 1 -- start start 2024-04-16T12:55:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 0x7f7bb404c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f64cbfff640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 0x7f64bc004f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009860 tx=0x7f64bc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2678d7c9f55b6927 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7bb4008d10 0x7f7bb4033dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f32c3fff640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 0x7f32a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4023160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb40071b0 con 0x7f7bb4008930 2024-04-16T12:55:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb40335c0 con 0x7f7bb403b020 2024-04-16T12:55:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbbfff640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb403b590 con 0x7f7bb4008d10 2024-04-16T12:55:34.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8031e60 con 0x7fe8c404ffd0 2024-04-16T12:55:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8ac001030 con 0x7fe8c404ffd0 2024-04-16T12:55:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fa133a8f640 1 -- 172.21.15.18:0/1247135091 shutdown_connections 2024-04-16T12:55:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fa133a8f640 1 --2- 172.21.15.18:0/1247135091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1180051c0 0x7fa11800b9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fa133a8f640 1 -- 172.21.15.18:0/1247135091 >> 172.21.15.18:0/1247135091 conn(0x7fa12c0d0b20 msgr2=0x7fa12c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0037070 con 0x7f64bc004ba0 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c0032600 con 0x7f64bc004ba0 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4023160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 0x7f7bb404c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 0x7f7bb404c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38900/0 (socket says 172.21.15.18:38900) 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bbaffd640 1 -- 172.21.15.18:0/1709386457 learned_addr learned my addr 172.21.15.18:0/1709386457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f7bba7fc640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7bb4008d10 0x7f7bb4033dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2758003a00 0x7f276c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 0x7f276c1ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f276c1edff0 0x7f276c1ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0b6de0 con 0x7f2758003a00 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f276c166690 con 0x7f276c1ec050 2024-04-16T12:55:34.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f27744c5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0b6f60 con 0x7f276c1edff0 2024-04-16T12:55:34.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fa133a8f640 1 -- 172.21.15.18:0/1247135091 shutdown_connections 2024-04-16T12:55:34.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f2771a60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 0x7f276c1ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f2771a60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 0x7f276c1ec4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55046/0 (socket says 172.21.15.18:55046) 2024-04-16T12:55:34.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bba7fc640 1 -- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 msgr2=0x7f7bb4023160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bba7fc640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb403b020 0x7f7bb4023160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bba7fc640 1 -- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 msgr2=0x7f7bb404c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f2771a60640 1 -- 172.21.15.18:0/6439340 learned_addr learned my addr 172.21.15.18:0/6439340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f791003a0d0 0x7f79101893a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7910055d40 0x7f791004ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79100df830 0x7f7910182680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f6e24f82640 1 Processor -- start 2024-04-16T12:55:34.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2772261640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2758003a00 0x7f276c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bba7fc640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 0x7f7bb404c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2772a62640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f276c1edff0 0x7f276c1ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f79167fc640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7910055d40 0x7f791004ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f79167fc640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7910055d40 0x7f791004ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56604/0 (socket says 172.21.15.18:56604) 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7916ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f791003a0d0 0x7f79101893a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 -- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f276c1edff0 msgr2=0x7f276c1ee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f276c1edff0 0x7f276c1ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 -- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2758003a00 msgr2=0x7f276c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2758003a00 0x7f276c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c1ecbc0 con 0x7f276c1ec050 2024-04-16T12:55:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2772261640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2758003a00 0x7f276c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f6e24f82640 1 -- start start 2024-04-16T12:55:34.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bba7fc640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb41863a0 con 0x7f7bb4008d10 2024-04-16T12:55:34.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79100dfc10 con 0x7f79100df830 2024-04-16T12:55:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7910007500 con 0x7f791003a0d0 2024-04-16T12:55:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f791d2ba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f791004ffb0 con 0x7f7910055d40 2024-04-16T12:55:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f79167fc640 1 -- 172.21.15.18:0/3829464515 learned_addr learned my addr 172.21.15.18:0/3829464515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f7bbaffd640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bb4008930 0x7f7bb404c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 msgr2=0x7f64bc004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f2771a60640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 0x7f276c1ec4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f275c00e7e0 tx=0x7f275c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7fa133a8f640 1 -- 172.21.15.18:0/1247135091 wait complete. 2024-04-16T12:55:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f64caffd640 1 -- 172.21.15.18:0/4246224589 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0037070 con 0x7f64bc004ba0 2024-04-16T12:55:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f64d23d4640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 0x7f64bc004f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009860 tx=0x7f64bc005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.295+0000 7f32bbfff640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a4004800 0x7f32a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c00f040 con 0x7f276c1ec050 2024-04-16T12:55:34.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f32c3fff640 1 -- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a4004800 msgr2=0x7f32a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 shutdown_connections 2024-04-16T12:55:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f64d23d4640 1 --2- 172.21.15.18:0/4246224589 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64bc004ba0 0x7f64bc004f80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 >> 172.21.15.18:0/4246224589 conn(0x7f64c4059010 msgr2=0x7f64c40593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f32c3fff640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a4004800 0x7f32a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7bba7fc640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7bb4008d10 0x7f7bb4033dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c390 tx=0x7f7bac00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f32c3fff640 1 -- 172.21.15.18:0/4093078051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32a40039b0 msgr2=0x7f32a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f32c3fff640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32a40039b0 0x7f32a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.296+0000 7f32c3fff640 1 -- 172.21.15.18:0/4093078051 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a4003520 con 0x7f32a40051c0 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 -- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7910055d40 msgr2=0x7f791004ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7910055d40 0x7f791004ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 -- 172.21.15.18:0/3829464515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79100df830 msgr2=0x7f7910182680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79100df830 0x7f7910182680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79100322e0 con 0x7f791003a0d0 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8b8038020 con 0x7fe8c404ffd0 2024-04-16T12:55:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7916ffd640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f791003a0d0 0x7f79101893a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c3f0 tx=0x7f790c00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 shutdown_connections 2024-04-16T12:55:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c1ecea0 con 0x7f276c1ec050 2024-04-16T12:55:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c1ed460 con 0x7f276c1ec050 2024-04-16T12:55:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c004030 con 0x7f276c1ec050 2024-04-16T12:55:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f6e24f82640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e180fe110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c004400 con 0x7f276c1ec050 2024-04-16T12:55:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f6e24f82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e1803a3d0 0x7f6e1818bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f32c3fff640 1 -- 172.21.15.18:0/4093078051 reap_dead start 2024-04-16T12:55:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f6e24f82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a830 0x7f6e181013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e24f82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e180544f0 con 0x7f6e1803a830 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e24f82640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18054370 con 0x7f6e1803a3d0 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e24f82640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6e18054670 con 0x7f6e18039cf0 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e1e59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e180fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e1e59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e180fe110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56610/0 (socket says 172.21.15.18:56610) 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e1e59c640 1 -- 172.21.15.18:0/4182240662 learned_addr learned my addr 172.21.15.18:0/4182240662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e1ed9d640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a830 0x7f6e181013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e1803a3d0 0x7f6e1818bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac017070 con 0x7f7bb4008d10 2024-04-16T12:55:34.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb4186680 con 0x7f7bb4008d10 2024-04-16T12:55:34.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7fa133a8f640 1 Processor -- start 2024-04-16T12:55:34.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb4186c40 con 0x7f7bb4008d10 2024-04-16T12:55:34.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bac0052d0 con 0x7f7bb4008d10 2024-04-16T12:55:34.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac003830 con 0x7f7bb4008d10 2024-04-16T12:55:34.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fa133a8f640 1 -- start start 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fe8b7fff640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8b006c9c0 0x7fe8b006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8b80ae3a0 con 0x7fe8c404ffd0 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fe8b7fff640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7fe8b0076140 0x7fe8b0078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8b0078c50 con 0x7fe8b0076140 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.298+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe8b80b5050 con 0x7fe8c404ffd0 2024-04-16T12:55:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fe8cb7fe640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8b006c9c0 0x7fe8b006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 -- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 msgr2=0x7f6e180fe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6e18039cf0 0x7f6e180fe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 -- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e1803a3d0 msgr2=0x7f6e1818bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e1803a3d0 0x7f6e1818bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e180fe650 con 0x7f6e1803a830 2024-04-16T12:55:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2754001030 con 0x7f276c1ec050 2024-04-16T12:55:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f32c3fff640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 0x7f32a400b9c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009fc0 tx=0x7f32a4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a76876c6d9059b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fe8cbfff640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7fe8b0076140 0x7fe8b0078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e1ed9d640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a830 0x7f6e181013d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c5c0 tx=0x7f6e1400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180051c0 0x7fa12c14e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa12c0cd1c0 0x7fa12c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 0x7fa12c161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c0b3540 con 0x7fa12c14b740 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c0b3a40 con 0x7fa12c0cd1c0 2024-04-16T12:55:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa133a8f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa12c0b36c0 con 0x7fa1180051c0 2024-04-16T12:55:34.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b9c001030 con 0x7f7bb4008d10 2024-04-16T12:55:34.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14015070 con 0x7f6e1803a830 2024-04-16T12:55:34.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e14004220 con 0x7f6e1803a830 2024-04-16T12:55:34.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1818b020 con 0x7f6e1803a830 2024-04-16T12:55:34.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.297+0000 7f64d23d4640 1 -- 172.21.15.18:0/4246224589 wait complete. 2024-04-16T12:55:34.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f64d23d4640 1 Processor -- start 2024-04-16T12:55:34.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f275c00c6d0 con 0x7f276c1ec050 2024-04-16T12:55:34.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc009c10 con 0x7f32a40051c0 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7fa13202c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 0x7fa12c161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13182b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180051c0 0x7fa12c14e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 0x7fa12c161450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38938/0 (socket says 172.21.15.18:38938) 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 -- 172.21.15.18:0/1550816379 learned_addr learned my addr 172.21.15.18:0/1550816379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc02cca0 con 0x7f32a40051c0 2024-04-16T12:55:34.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.299+0000 7f32c2ffd640 1 -- 172.21.15.18:0/4093078051 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc003bd0 con 0x7f32a40051c0 2024-04-16T12:55:34.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fe8cb7fe640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8b006c9c0 0x7fe8b006ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006b10 tx=0x7fe8c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bac01a070 con 0x7f7bb4008d10 2024-04-16T12:55:34.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fe8cbfff640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7fe8b0076140 0x7fe8b0078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 -- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180051c0 msgr2=0x7fa12c14e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa1180051c0 0x7fa12c14e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 -- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa12c0cd1c0 msgr2=0x7fa12c158520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa12c0cd1c0 0x7fa12c158520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7fa13202c640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c14bd00 con 0x7fa12c14b740 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14003610 con 0x7f6e1803a830 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1818b5e0 con 0x7f6e1803a830 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f2762ffd640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f275006c9f0 0x7f275006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f275c08be60 con 0x7f276c1ec050 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f2762ffd640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2750076170 0x7f27500785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f275c008eb0 con 0x7f2750076170 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f275c08e4c0 con 0x7f276c1ec050 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f2772a62640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2750076170 0x7f27500785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f7ba3fff640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ba806c9c0 0x7f7ba806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.300+0000 7f64d23d4640 1 -- start start 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004ba0 0x7f64c41856a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c403a540 0x7f64c40e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64c4050050 0x7f64c4051e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa13202c640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 0x7fa12c161450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa124003d80 tx=0x7fa1240036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40e78b0 con 0x7f64bc004ba0 2024-04-16T12:55:34.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== osd.3 v2:172.21.15.18:6808/1981163326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8b0078c50 con 0x7fe8b0076140 2024-04-16T12:55:34.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64c40ebd20 con 0x7f64c403a540 2024-04-16T12:55:34.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64d23d4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f64c4058ac0 con 0x7f64c4050050 2024-04-16T12:55:34.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64cb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c403a540 0x7f64c40e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f7bbaffd640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ba806c9c0 0x7f7ba806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64cb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c403a540 0x7f64c40e8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55066/0 (socket says 172.21.15.18:55066) 2024-04-16T12:55:34.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64cb7fe640 1 -- 172.21.15.18:0/3471522600 learned_addr learned my addr 172.21.15.18:0/3471522600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7bac08b0f0 con 0x7f7bb4008d10 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12403e670 con 0x7fa12c14b740 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa124044070 con 0x7fa12c14b740 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12403ea10 con 0x7fa12c14b740 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa133a8f640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c14bfe0 con 0x7fa12c14b740 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f64cbfff640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004ba0 0x7f64c41856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f2772261640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f275006c9f0 0x7f275006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0052d0 con 0x7f791003a0d0 2024-04-16T12:55:34.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f7ba3fff640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f7ba8076130 0x7f7ba8078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c005470 con 0x7f791003a0d0 2024-04-16T12:55:34.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c007240 con 0x7f791003a0d0 2024-04-16T12:55:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791004d380 con 0x7f791003a0d0 2024-04-16T12:55:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ba8078c40 con 0x7f7ba8076130 2024-04-16T12:55:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7bac092050 con 0x7f7bb4008d10 2024-04-16T12:55:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f2772a62640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2750076170 0x7f27500785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7910189ed0 con 0x7f791003a0d0 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f64cbfff640 1 -- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64c4050050 msgr2=0x7f64c4051e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f64cbfff640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f64c4050050 0x7f64c4051e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f64cbfff640 1 -- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c403a540 msgr2=0x7f64c40e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f64cbfff640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c403a540 0x7f64c40e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f64cbfff640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c403d2c0 con 0x7f64bc004ba0 2024-04-16T12:55:34.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.302+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e1818add0 con 0x7f6e1803a830 2024-04-16T12:55:34.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 msgr2=0x7f32a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7f32c89c8640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 0x7f32a400b9c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009fc0 tx=0x7f32a4005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f7bbaffd640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ba806c9c0 0x7f7ba806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0635c0 tx=0x7f7bbc06b940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.301+0000 7fa133a8f640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c14e1a0 con 0x7fa12c14b740 2024-04-16T12:55:34.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7910005810 con 0x7f791003a0d0 2024-04-16T12:55:34.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 shutdown_connections 2024-04-16T12:55:34.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f32c89c8640 1 --2- 172.21.15.18:0/4093078051 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32a40051c0 0x7f32a400b9c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 >> 172.21.15.18:0/4093078051 conn(0x7f32c4072fe0 msgr2=0x7f32c406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f2772261640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f275006c9f0 0x7f275006eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2764036000 tx=0x7f2764030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f64cbfff640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004ba0 0x7f64c41856a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64c0032000 tx=0x7f64c0004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa108001030 con 0x7fa12c14b740 2024-04-16T12:55:34.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 shutdown_connections 2024-04-16T12:55:34.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f32c89c8640 1 -- 172.21.15.18:0/4093078051 wait complete. 2024-04-16T12:55:34.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== osd.1 v2:172.21.15.18:6800/1248885082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f275c008eb0 con 0x7f2750076170 2024-04-16T12:55:34.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.303+0000 7f7bbb7fe640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f7ba8076130 0x7f7ba8078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0042070 con 0x7f64bc004ba0 2024-04-16T12:55:34.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c003e870 con 0x7f64bc004ba0 2024-04-16T12:55:34.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0037040 con 0x7f64bc004ba0 2024-04-16T12:55:34.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c403d560 con 0x7f64bc004ba0 2024-04-16T12:55:34.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f7bbb7fe640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f7ba8076130 0x7f7ba8078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f790c0073e0 con 0x7f791003a0d0 2024-04-16T12:55:34.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c403db20 con 0x7f64bc004ba0 2024-04-16T12:55:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.304+0000 7f78ff7fe640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f790406c9c0 0x7f790406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f790c08b170 con 0x7f791003a0d0 2024-04-16T12:55:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f78ff7fe640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f7904076140 0x7f7904078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f790c009e50 con 0x7f7904076140 2024-04-16T12:55:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f790c092050 con 0x7f791003a0d0 2024-04-16T12:55:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e140037b0 con 0x7f6e1803a830 2024-04-16T12:55:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== osd.2 v2:172.21.15.18:6821/2059210548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ba8078c40 con 0x7f7ba8076130 2024-04-16T12:55:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f79177fe640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f7904076140 0x7f7904078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7f79167fc640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f790406c9c0 0x7f790406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.305+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa12403ebb0 con 0x7fa12c14b740 2024-04-16T12:55:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f6e0effd640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6e0006c9c0 0x7f6e0006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa12a7fc640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa11006c9f0 0x7fa11006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f6e1e59c640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6e0006c9c0 0x7f6e0006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e1408bc00 con 0x7f6e1803a830 2024-04-16T12:55:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa13182b640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa11006c9f0 0x7fa11006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa1240ae3f0 con 0x7fa12c14b740 2024-04-16T12:55:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f79167fc640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f790406c9c0 0x7f790406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79100505a0 tx=0x7f7908008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa12a7fc640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7fa110076170 0x7fa1100785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa110078c80 con 0x7fa110076170 2024-04-16T12:55:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f79177fe640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f7904076140 0x7f7904078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7f6e0effd640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f6e00076130 0x7f6e00078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa1240ae7e0 con 0x7fa12c14b740 2024-04-16T12:55:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.306+0000 7fa13182b640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa11006c9f0 0x7fa11006eeb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa120001eb0 tx=0x7fa120009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64c40053c0 con 0x7f64bc004ba0 2024-04-16T12:55:34.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f6e1e59c640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6e0006c9c0 0x7f6e0006ee80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e10006fd0 tx=0x7f6e10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7fa13102a640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7fa110076170 0x7fa1100785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e14010e50 con 0x7f6e00076130 2024-04-16T12:55:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e140902a0 con 0x7f6e1803a830 2024-04-16T12:55:34.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64c0045070 con 0x7f64bc004ba0 2024-04-16T12:55:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f6e00076130 0x7f6e00078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f32c89c8640 1 Processor -- start 2024-04-16T12:55:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f32c89c8640 1 -- start start 2024-04-16T12:55:34.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7fa13102a640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7fa110076170 0x7fa1100785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f6e1dd9b640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f6e00076130 0x7f6e00078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== osd.4 v2:172.21.15.104:6800/1931817062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f790c009e50 con 0x7f7904076140 2024-04-16T12:55:34.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.307+0000 7f64c8ff9640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f64b006c920 0x7f64b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f64c00ad960 con 0x7f64bc004ba0 2024-04-16T12:55:34.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64c8ff9640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f64b0076090 0x7f64b00784d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a40051c0 0x7f32c4141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64c0004510 con 0x7f64b0076090 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32c40acb60 0x7f32c40a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32c40a9fa0 0x7f32c40aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4070420 con 0x7f32c40a9fa0 2024-04-16T12:55:34.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4070140 con 0x7f32a40051c0 2024-04-16T12:55:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c89c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f32c406f380 con 0x7f32c40acb60 2024-04-16T12:55:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== osd.5 v2:172.21.15.104:6816/666429415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa110078c80 con 0x7fa110076170 2024-04-16T12:55:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== osd.6 v2:172.21.15.104:6808/3808085742 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e14010e50 con 0x7f6e00076130 2024-04-16T12:55:34.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32c40acb60 0x7f32c40a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a40051c0 0x7f32c4141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a40051c0 0x7f32c4141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55072/0 (socket says 172.21.15.18:55072) 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f32c37fe640 1 -- 172.21.15.18:0/490609139 learned_addr learned my addr 172.21.15.18:0/490609139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f64c00b22a0 con 0x7f64bc004ba0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64cb7fe640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f64b006c920 0x7f64b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.308+0000 7f64d0971640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f64b0076090 0x7f64b00784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f64cb7fe640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f64b006c920 0x7f64b006ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001050 tx=0x7f64b8007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f64d0971640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f64b0076090 0x7f64b00784d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32c3fff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32c40a9fa0 0x7f32c40aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 -- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a40051c0 msgr2=0x7f32c4141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32a40051c0 0x7f32c4141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 -- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32c40a9fa0 msgr2=0x7f32c40aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32c40a9fa0 0x7f32c40aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 -- 172.21.15.18:0/490609139 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c40ad020 con 0x7f32c40acb60 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.309+0000 7f32bbfff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32c40acb60 0x7f32c40a9590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000ff0 tx=0x7f32ac0087a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.310+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac01a070 con 0x7f32c40acb60 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.310+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac00f920 con 0x7f32c40acb60 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.310+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c40ad300 con 0x7f32c40acb60 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.311+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00fcf0 con 0x7f32c40acb60 2024-04-16T12:55:34.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.310+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== osd.7 v2:172.21.15.104:6824/2122105162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64c0004510 con 0x7f64b0076090 2024-04-16T12:55:34.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.311+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c40ce3a0 con 0x7f32c40acb60 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.313+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32ac01d070 con 0x7f32c40acb60 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.313+0000 7f32c0ff9640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f32a806c9c0 0x7f32a806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.314+0000 7f32c37fe640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f32a806c9c0 0x7f32a806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.314+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f32ac08b5d0 con 0x7f32c40acb60 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.314+0000 7f32c37fe640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f32a806c9c0 0x7f32a806ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32b4004790 tx=0x7f32b4009630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.315+0000 7f32c89c8640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f32c41fc1d0 0x7f32c41fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.316+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 --> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32c40ce5a0 con 0x7f32c41fc1d0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.316+0000 7f32c3fff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f32c41fc1d0 0x7f32c41fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.316+0000 7f32c3fff640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f32c41fc1d0 0x7f32c41fc5b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.317+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== osd.0 v2:172.21.15.18:6816/3833675534 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32c40ce5a0 con 0x7f32c41fc1d0 2024-04-16T12:55:34.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.333+0000 7fe8d0dc0640 1 -- 172.21.15.18:0/3551145043 --> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8ac002dd0 con 0x7fe8b0076140 2024-04-16T12:55:34.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.333+0000 7fe8b7fff640 1 -- 172.21.15.18:0/3551145043 <== osd.3 v2:172.21.15.18:6808/1981163326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8ac002dd0 con 0x7fe8b0076140 2024-04-16T12:55:34.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7fe8b0076140 msgr2=0x7fe8b0078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7fe8b0076140 0x7fe8b0078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8b006c9c0 msgr2=0x7fe8b006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe8b006c9c0 0x7fe8b006ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0006b10 tx=0x7fe8c0008040 comp rx=0 tx=0).stop 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8c404ffd0 msgr2=0x7fe8c4043680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 --2- 172.21.15.18:0/3551145043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8c404ffd0 0x7fe8c4043680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8033000 tx=0x7fe8b80046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8cbfff640 1 -- 172.21.15.18:0/3551145043 reap_dead start 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 shutdown_connections 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.334+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 >> 172.21.15.18:0/3551145043 conn(0x7fe8c4009fb0 msgr2=0x7fe8c4033ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.335+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 shutdown_connections 2024-04-16T12:55:34.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.335+0000 7fe8b5ffb640 1 -- 172.21.15.18:0/3551145043 wait complete. 2024-04-16T12:55:34.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.337+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 --> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b9c002dd0 con 0x7f7ba8076130 2024-04-16T12:55:34.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.338+0000 7f7ba3fff640 1 -- 172.21.15.18:0/1709386457 <== osd.2 v2:172.21.15.18:6821/2059210548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b9c002dd0 con 0x7f7ba8076130 2024-04-16T12:55:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.337+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 --> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2754002dd0 con 0x7f2750076170 2024-04-16T12:55:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f2762ffd640 1 -- 172.21.15.18:0/6439340 <== osd.1 v2:172.21.15.18:6800/1248885082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2754002dd0 con 0x7f2750076170 2024-04-16T12:55:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f7ba8076130 msgr2=0x7f7ba8078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f7ba8076130 0x7f7ba8078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ba806c9c0 msgr2=0x7f7ba806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ba806c9c0 0x7f7ba806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0635c0 tx=0x7f7bbc06b940 comp rx=0 tx=0).stop 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2750076170 msgr2=0x7f27500785b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2750076170 0x7f27500785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7bb4008d10 msgr2=0x7f7bb4033dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbbfff640 1 --2- 172.21.15.18:0/1709386457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7bb4008d10 0x7f7bb4033dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c390 tx=0x7f7bac00c850 comp rx=0 tx=0).stop 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f7bbb7fe640 1 -- 172.21.15.18:0/1709386457 reap_dead start 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f275006c9f0 msgr2=0x7f275006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f275006c9f0 0x7f275006eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2764036000 tx=0x7f2764030000 comp rx=0 tx=0).stop 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 msgr2=0x7f276c1ec4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 --2- 172.21.15.18:0/6439340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f276c1ec050 0x7f276c1ec4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f275c00e7e0 tx=0x7f275c00eca0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f2772a62640 1 -- 172.21.15.18:0/6439340 reap_dead start 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 shutdown_connections 2024-04-16T12:55:34.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.339+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 >> 172.21.15.18:0/6439340 conn(0x7f276c0b62b0 msgr2=0x7f276c0b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 shutdown_connections 2024-04-16T12:55:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 >> 172.21.15.18:0/1709386457 conn(0x7f7bb401ef30 msgr2=0x7f7bb4037ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 shutdown_connections 2024-04-16T12:55:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 shutdown_connections 2024-04-16T12:55:34.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f7bbbfff640 1 -- 172.21.15.18:0/1709386457 wait complete. 2024-04-16T12:55:34.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.340+0000 7f27744c5640 1 -- 172.21.15.18:0/6439340 wait complete. 2024-04-16T12:55:34.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.341+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 --> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f791004f7e0 con 0x7f7904076140 2024-04-16T12:55:34.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.341+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 --> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e180053c0 con 0x7f6e00076130 2024-04-16T12:55:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.341+0000 7f78ff7fe640 1 -- 172.21.15.18:0/3829464515 <== osd.4 v2:172.21.15.104:6800/1931817062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f791004f7e0 con 0x7f7904076140 2024-04-16T12:55:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f6e0effd640 1 -- 172.21.15.18:0/4182240662 <== osd.6 v2:172.21.15.104:6808/3808085742 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e180053c0 con 0x7f6e00076130 2024-04-16T12:55:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f7904076140 msgr2=0x7f7904078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f791d2ba640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f7904076140 0x7f7904078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 --> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64c400dfb0 con 0x7f64b0076090 2024-04-16T12:55:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f6e00076130 msgr2=0x7f6e00078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f6e24f82640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f6e00076130 0x7f6e00078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f790406c9c0 msgr2=0x7f790406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f791d2ba640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f790406c9c0 0x7f790406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79100505a0 tx=0x7f7908008040 comp rx=0 tx=0).stop 2024-04-16T12:55:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f791003a0d0 msgr2=0x7f79101893a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f791d2ba640 1 --2- 172.21.15.18:0/3829464515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f791003a0d0 0x7f79101893a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c3f0 tx=0x7f790c00c8b0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f79177fe640 1 -- 172.21.15.18:0/3829464515 reap_dead start 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.342+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6e0006c9c0 msgr2=0x7f6e0006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6e0006c9c0 0x7f6e0006ee80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e10006fd0 tx=0x7f6e10008040 comp rx=0 tx=0).stop 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a830 msgr2=0x7f6e181013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 --2- 172.21.15.18:0/4182240662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1803a830 0x7f6e181013d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c5c0 tx=0x7f6e1400ca80 comp rx=0 tx=0).stop 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 shutdown_connections 2024-04-16T12:55:34.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 >> 172.21.15.18:0/3829464515 conn(0x7f791001e6f0 msgr2=0x7f7910007920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e1ed9d640 1 -- 172.21.15.18:0/4182240662 reap_dead start 2024-04-16T12:55:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 shutdown_connections 2024-04-16T12:55:34.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 >> 172.21.15.18:0/4182240662 conn(0x7f6e18009fe0 msgr2=0x7f6e18036800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 shutdown_connections 2024-04-16T12:55:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f791d2ba640 1 -- 172.21.15.18:0/3829464515 wait complete. 2024-04-16T12:55:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 shutdown_connections 2024-04-16T12:55:34.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f64c8ff9640 1 -- 172.21.15.18:0/3471522600 <== osd.7 v2:172.21.15.104:6824/2122105162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64c400dfb0 con 0x7f64b0076090 2024-04-16T12:55:34.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7f6e24f82640 1 -- 172.21.15.18:0/4182240662 wait complete. 2024-04-16T12:55:34.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.343+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 --> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa108002d10 con 0x7fa110076170 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f64b0076090 msgr2=0x7f64b00784d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f64b0076090 0x7f64b00784d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f64b006c920 msgr2=0x7f64b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f64b006c920 0x7f64b006ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001050 tx=0x7f64b8007040 comp rx=0 tx=0).stop 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004ba0 msgr2=0x7f64c41856a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 --2- 172.21.15.18:0/3471522600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64bc004ba0 0x7f64c41856a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64c0032000 tx=0x7f64c0004700 comp rx=0 tx=0).stop 2024-04-16T12:55:34.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d0971640 1 -- 172.21.15.18:0/3471522600 reap_dead start 2024-04-16T12:55:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7fa12a7fc640 1 -- 172.21.15.18:0/1550816379 <== osd.5 v2:172.21.15.104:6816/666429415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa108002d10 con 0x7fa110076170 2024-04-16T12:55:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 shutdown_connections 2024-04-16T12:55:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 >> 172.21.15.18:0/3471522600 conn(0x7f64c4059010 msgr2=0x7f64c4037c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.344+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 shutdown_connections 2024-04-16T12:55:34.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7f64d23d4640 1 -- 172.21.15.18:0/3471522600 wait complete. 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7fa110076170 msgr2=0x7fa1100785b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7fa110076170 0x7fa1100785b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa11006c9f0 msgr2=0x7fa11006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa11006c9f0 0x7fa11006eeb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa120001eb0 tx=0x7fa120009040 comp rx=0 tx=0).stop 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 msgr2=0x7fa12c161450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 --2- 172.21.15.18:0/1550816379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa12c14b740 0x7fa12c161450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa124003d80 tx=0x7fa1240036f0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa13202c640 1 -- 172.21.15.18:0/1550816379 reap_dead start 2024-04-16T12:55:34.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 shutdown_connections 2024-04-16T12:55:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.345+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 >> 172.21.15.18:0/1550816379 conn(0x7fa12c0d0b20 msgr2=0x7fa12c166f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.346+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 shutdown_connections 2024-04-16T12:55:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.346+0000 7fa10ffff640 1 -- 172.21.15.18:0/1550816379 wait complete. 2024-04-16T12:55:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.347+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 --> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32c41619f0 con 0x7f32c41fc1d0 2024-04-16T12:55:34.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.348+0000 7f32c0ff9640 1 -- 172.21.15.18:0/490609139 <== osd.0 v2:172.21.15.18:6816/3833675534 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32c41619f0 con 0x7f32c41fc1d0 2024-04-16T12:55:34.432 INFO:teuthology.orchestra.run.smithi018.stdout:55834574858 2024-04-16T12:55:34.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f32c41fc1d0 msgr2=0x7f32c41fc5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f32c41fc1d0 0x7f32c41fc5b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f32a806c9c0 msgr2=0x7f32a806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f32a806c9c0 0x7f32a806ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32b4004790 tx=0x7f32b4009630 comp rx=0 tx=0).stop 2024-04-16T12:55:34.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32c40acb60 msgr2=0x7f32c40a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c89c8640 1 --2- 172.21.15.18:0/490609139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f32c40acb60 0x7f32c40a9590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000ff0 tx=0x7f32ac0087a0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.353+0000 7f32c3fff640 1 -- 172.21.15.18:0/490609139 reap_dead start 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.356+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 shutdown_connections 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.356+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 >> 172.21.15.18:0/490609139 conn(0x7f32c4072fe0 msgr2=0x7f32c40b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.356+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 shutdown_connections 2024-04-16T12:55:34.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.356+0000 7f32c89c8640 1 -- 172.21.15.18:0/490609139 wait complete. 2024-04-16T12:55:34.436 INFO:teuthology.orchestra.run.smithi018.stdout:55834574857 2024-04-16T12:55:34.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T12:55:34.437 INFO:teuthology.orchestra.run.smithi018.stdout:55834574859 2024-04-16T12:55:34.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T12:55:34.438 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2024-04-16T12:55:34.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T12:55:34.439 INFO:teuthology.orchestra.run.smithi018.stdout:55834574858 2024-04-16T12:55:34.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T12:55:34.440 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-16T12:55:34.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T12:55:34.441 INFO:teuthology.orchestra.run.smithi018.stdout:60129542156 2024-04-16T12:55:34.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T12:55:34.442 INFO:teuthology.orchestra.run.smithi018.stdout:55834574857 2024-04-16T12:55:34.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T12:55:34.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:55:34.610 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:55:34.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.654+0000 7f257f59d640 1 Processor -- start 2024-04-16T12:55:34.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.654+0000 7f257f59d640 1 -- start start 2024-04-16T12:55:34.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f442ccc8640 1 Processor -- start 2024-04-16T12:55:34.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257f59d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f25780d1640 0x7f25780d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257f59d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2578163050 con 0x7f25780d22b0 2024-04-16T12:55:34.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257f59d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25781632f0 con 0x7f2578162c70 2024-04-16T12:55:34.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f442ccc8640 1 -- start start 2024-04-16T12:55:34.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257f59d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f25780cf5d0 con 0x7f25780d1640 2024-04-16T12:55:34.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f21c0dbd640 1 Processor -- start 2024-04-16T12:55:34.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257ed9c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f25780d22b0 0x7f25780d2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37040/0 (socket says 172.21.15.18:37040) 2024-04-16T12:55:34.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7fb318b46640 1 Processor -- start 2024-04-16T12:55:34.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7fb318b46640 1 -- start start 2024-04-16T12:55:34.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f257ed9c640 1 -- 172.21.15.18:0/1841847505 learned_addr learned my addr 172.21.15.18:0/1841847505 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:34.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7f21c0dbd640 1 -- start start 2024-04-16T12:55:34.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312428813 0 0) 0x7f2578163050 con 0x7f25780d22b0 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2564003520 con 0x7f25780d22b0 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2619784837 0 0) 0x7f2564003520 con 0x7f25780d22b0 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 >> v2:172.21.15.104:3300/0 conn(0x7f25780d1640 msgr2=0x7f25780d1af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 --2- 172.21.15.18:0/1841847505 >> v2:172.21.15.104:3300/0 conn(0x7f25780d1640 0x7f25780d1af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7ff819f48640 1 Processor -- start 2024-04-16T12:55:34.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.656+0000 7ff819f48640 1 -- start start 2024-04-16T12:55:34.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 >> v1:172.21.15.104:6789/0 conn(0x7f2578162c70 legacy=0x7f25780ceec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:55:34.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f15d4a8f640 1 Processor -- start 2024-04-16T12:55:34.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f15d4a8f640 1 -- start start 2024-04-16T12:55:34.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25781635d0 con 0x7f25780d22b0 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb318b46640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb30c0e1090 0x7fb30c038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb318b46640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb318b46640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c04f540 con 0x7fb30c03a400 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb318b46640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb30c04f820 con 0x7fb30c0e1090 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb318b46640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c04fb00 con 0x7fb30c050dd0 2024-04-16T12:55:34.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f2568001690 con 0x7f25780d22b0 2024-04-16T12:55:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4428164020 0x7f442806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f442806cf70 0x7f44280ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 0x7f4428166a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 >> v1:172.21.15.18:6789/0 conn(0x7f25780d22b0 legacy=0x7f25780d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f15d4a8f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15d015b5b0 0x7f15d015b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f44280af1e0 con 0x7f44280ae9f0 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f44280af4c0 con 0x7f4428164020 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.657+0000 7f442ccc8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f44281647f0 con 0x7f442806cf70 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4428164020 0x7f442806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f4425d9b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f442806cf70 0x7f44280ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4428164020 0x7f442806ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55082/0 (socket says 172.21.15.18:55082) 2024-04-16T12:55:34.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 -- 172.21.15.18:0/2445667531 learned_addr learned my addr 172.21.15.18:0/2445667531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2564003a80 0x7f2564003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21c0dbd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 0x7f21bc163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21c0dbd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 0x7f21bc167050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21c0dbd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21bc164310 con 0x7f21bc06ca30 2024-04-16T12:55:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21c0dbd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f21bc0b0090 con 0x7f21bc06ceb0 2024-04-16T12:55:34.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21c0dbd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f21bc0cf7a0 con 0x7f21bc15d2f0 2024-04-16T12:55:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21ba59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 0x7f21bc163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21b9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f21bc06ca30 0x7f21bc166940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37046/0 (socket says 172.21.15.18:37046) 2024-04-16T12:55:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21b9d9b640 1 -- 172.21.15.18:0/2311364683 learned_addr learned my addr 172.21.15.18:0/2311364683 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f21bad9d640 1 --2- 172.21.15.18:0/2311364683 >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 0x7f21bc167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f257d599640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 0x7f2564004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257d599640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25640053c0 0x7f256400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f15d4a8f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d006dea0 con 0x7f15d00b5660 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f15d4a8f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d006e140 con 0x7f15d006ef00 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f15d4a8f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f15d006e420 con 0x7f15d015b5b0 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15d015b5b0 0x7f15d015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f15d00b5660 0x7f15d006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37058/0 (socket says 172.21.15.18:37058) 2024-04-16T12:55:34.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15d015b5b0 0x7f15d015b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55094/0 (socket says 172.21.15.18:55094) 2024-04-16T12:55:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 -- 172.21.15.18:0/1743972422 learned_addr learned my addr 172.21.15.18:0/1743972422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 -- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f442806cf70 msgr2=0x7f44280ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 --2- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f442806cf70 0x7f44280ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7f442659c640 1 -- 172.21.15.18:0/2445667531 >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 msgr2=0x7f4428166a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T12:55:34.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25780cf5d0 con 0x7f2564004800 2024-04-16T12:55:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f4426d9d640 1 --2- 172.21.15.18:0/2445667531 >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 0x7f4428166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f256400c280 con 0x7f25640053c0 2024-04-16T12:55:34.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257e59b640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2564003a80 0x7f2564003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f256400c480 con 0x7f2564003a80 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 -- 172.21.15.18:0/1743972422 >> v1:172.21.15.104:6789/0 conn(0x7f15d006ef00 legacy=0x7f15d00b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 -- 172.21.15.18:0/1743972422 >> v1:172.21.15.18:6789/0 conn(0x7f15d00b5660 legacy=0x7f15d006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f15cf7fe640 1 -- 172.21.15.18:0/1743972422 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d006e700 con 0x7f15d015b5b0 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21b959a640 1 -- 172.21.15.18:0/2311364683 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931711220 0 0) 0x7f21b0001110 con 0x7f21bc06ca30 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff819f48640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff81406f1a0 0x7ff81406f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff819f48640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff819f48640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81416b860 con 0x7ff8140b5340 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff819f48640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff81408bbc0 con 0x7ff81406f1a0 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff819f48640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff81406c430 con 0x7ff8140b4ec0 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56676/0 (socket says 172.21.15.18:56676) 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257ed9c640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25640053c0 0x7f256400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f257dd9a640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 0x7f2564004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 -- 172.21.15.18:0/3474845012 learned_addr learned my addr 172.21.15.18:0/3474845012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff818f46640 1 --2- 172.21.15.18:0/3474845012 >> v2:172.21.15.104:3300/0 conn(0x7ff81406f1a0 0x7ff81406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f257dd9a640 1 -- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2564003a80 msgr2=0x7f2564003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f257dd9a640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2564003a80 0x7f2564003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f257dd9a640 1 -- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25640053c0 msgr2=0x7f256400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f257dd9a640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25640053c0 0x7f256400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f257dd9a640 1 -- 172.21.15.18:0/1841847505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2564003520 con 0x7f2564004800 2024-04-16T12:55:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21b959a640 1 -- 172.21.15.18:0/2311364683 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21a4003520 con 0x7f21bc06ca30 2024-04-16T12:55:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb3137fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb30c0e1090 0x7fb30c038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb3137fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb30c0e1090 0x7fb30c038630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55090/0 (socket says 172.21.15.18:55090) 2024-04-16T12:55:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.658+0000 7fb3137fe640 1 -- 172.21.15.18:0/2921084115 learned_addr learned my addr 172.21.15.18:0/2921084115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7fb312ffd640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7fb3137fe640 1 -- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 msgr2=0x7fb30c039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7fb3137fe640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c039ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7fb3137fe640 1 -- 172.21.15.18:0/2921084115 >> v1:172.21.15.104:6789/0 conn(0x7fb30c03a400 legacy=0x7fb30c0e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7fb3137fe640 1 -- 172.21.15.18:0/2921084115 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c04fde0 con 0x7fb30c0e1090 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21ba59c640 1 -- 172.21.15.18:0/2311364683 >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 msgr2=0x7f21bc167050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21ba59c640 1 --2- 172.21.15.18:0/2311364683 >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 0x7f21bc167050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f15cf7fe640 1 --2- 172.21.15.18:0/1743972422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d015b5b0 0x7f15d015b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d006f3b0 tx=0x7f15c802e2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43be20225f67fbe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21ba59c640 1 -- 172.21.15.18:0/2311364683 >> v1:172.21.15.18:6789/0 conn(0x7f21bc06ca30 legacy=0x7f21bc166940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 -- 172.21.15.18:0/3474845012 >> v2:172.21.15.104:3300/0 conn(0x7ff81406f1a0 msgr2=0x7ff81406f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 --2- 172.21.15.18:0/3474845012 >> v2:172.21.15.104:3300/0 conn(0x7ff81406f1a0 0x7ff81406f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 -- 172.21.15.18:0/3474845012 >> v1:172.21.15.104:6789/0 conn(0x7ff8140b5340 legacy=0x7ff8140b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7ff813fff640 1 -- 172.21.15.18:0/3474845012 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81406fac0 con 0x7ff8140b4ec0 2024-04-16T12:55:34.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f21ba59c640 1 -- 172.21.15.18:0/2311364683 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc06e350 con 0x7f21bc15d2f0 2024-04-16T12:55:34.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.660+0000 7f21bad9d640 1 --2- 172.21.15.18:0/2311364683 >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 0x7f21bc167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f15ce7fc640 1 -- 172.21.15.18:0/1743972422 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8034070 con 0x7f15d015b5b0 2024-04-16T12:55:34.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f15ce7fc640 1 -- 172.21.15.18:0/1743972422 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c802ee50 con 0x7f15d015b5b0 2024-04-16T12:55:34.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f21ba59c640 1 --2- 172.21.15.18:0/2311364683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 0x7f21bc163dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097a0 tx=0x7f21ac02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2549a83cf862822e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f442659c640 1 --2- 172.21.15.18:0/2445667531 >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 0x7f4428166a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.659+0000 7f442659c640 1 -- 172.21.15.18:0/2445667531 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4428164ad0 con 0x7f4428164020 2024-04-16T12:55:34.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f4426d9d640 1 --2- 172.21.15.18:0/2445667531 >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 0x7f4428166a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f21b959a640 1 -- 172.21.15.18:0/2311364683 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0315a0 con 0x7f21bc15d2f0 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f21b959a640 1 -- 172.21.15.18:0/2311364683 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac037070 con 0x7f21bc15d2f0 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f21b959a640 1 -- 172.21.15.18:0/2311364683 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0315a0 con 0x7f21bc15d2f0 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f257dd9a640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 0x7f2564004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2570009e60 tx=0x7f2564005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a3080fc6444e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f15ce7fc640 1 -- 172.21.15.18:0/1743972422 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8038880 con 0x7f15d015b5b0 2024-04-16T12:55:34.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570039070 con 0x7f2564004800 2024-04-16T12:55:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.661+0000 7f442659c640 1 --2- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f442806ca30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44280682f0 tx=0x7f442002be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05a7fa4097d379d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257002cdb0 con 0x7f2564004800 2024-04-16T12:55:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f257d599640 1 -- 172.21.15.18:0/1841847505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570009a30 con 0x7f2564004800 2024-04-16T12:55:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7ff813fff640 1 --2- 172.21.15.18:0/3474845012 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c02bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daccd68c11031964 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f15d4a8f640 1 -- 172.21.15.18:0/1743972422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d015b5b0 msgr2=0x7f15d015b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/1743972422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d015b5b0 0x7f15d015b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d006f3b0 tx=0x7f15c802e2a0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7fb3137fe640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c038630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb308009870 tx=0x7fb30802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304132fa4fefa0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f257ed9c640 1 -- 172.21.15.18:0/1841847505 reap_dead start 2024-04-16T12:55:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f442559a640 1 -- 172.21.15.18:0/2445667531 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442002ca10 con 0x7f4428164020 2024-04-16T12:55:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 -- 172.21.15.18:0/2311364683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 msgr2=0x7f21bc163dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7ff8137fe640 1 -- 172.21.15.18:0/3474845012 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c02caa0 con 0x7ff8140b4ec0 2024-04-16T12:55:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f442559a640 1 -- 172.21.15.18:0/2445667531 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442002cbb0 con 0x7f4428164020 2024-04-16T12:55:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f442559a640 1 -- 172.21.15.18:0/2445667531 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44200343f0 con 0x7f4428164020 2024-04-16T12:55:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7ff8137fe640 1 -- 172.21.15.18:0/3474845012 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c02cc40 con 0x7ff8140b4ec0 2024-04-16T12:55:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7ff8137fe640 1 -- 172.21.15.18:0/3474845012 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c034610 con 0x7ff8140b4ec0 2024-04-16T12:55:34.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f15d4a8f640 1 -- 172.21.15.18:0/1743972422 shutdown_connections 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/1743972422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d015b5b0 0x7f15d015b990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f15d4a8f640 1 -- 172.21.15.18:0/1743972422 >> 172.21.15.18:0/1743972422 conn(0x7f15d00b24f0 msgr2=0x7f15d00b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/2311364683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 0x7f21bc163dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097a0 tx=0x7f21ac02b840 comp rx=0 tx=0).stop 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 -- 172.21.15.18:0/2311364683 shutdown_connections 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/2311364683 >> v2:172.21.15.104:3300/0 conn(0x7f21bc06ceb0 0x7f21bc167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/2311364683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc15d2f0 0x7f21bc163dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 -- 172.21.15.18:0/2311364683 >> 172.21.15.18:0/2311364683 conn(0x7f21bc0b2940 msgr2=0x7f21bc072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 -- 172.21.15.18:0/2311364683 shutdown_connections 2024-04-16T12:55:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7f21c0dbd640 1 -- 172.21.15.18:0/2311364683 wait complete. 2024-04-16T12:55:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7fb3127fc640 1 -- 172.21.15.18:0/2921084115 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308035020 con 0x7fb30c0e1090 2024-04-16T12:55:34.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.662+0000 7fb3127fc640 1 -- 172.21.15.18:0/2921084115 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308031640 con 0x7fb30c0e1090 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 -- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 msgr2=0x7fb30c038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c038630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb308009870 tx=0x7fb30802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 -- 172.21.15.18:0/3474845012 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 msgr2=0x7ff8140b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 --2- 172.21.15.18:0/3474845012 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c02bf00 comp rx=0 tx=0).stop 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 -- 172.21.15.18:0/3474845012 shutdown_connections 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 --2- 172.21.15.18:0/3474845012 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8140b4ec0 0x7ff8140b33d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 --2- 172.21.15.18:0/3474845012 >> v2:172.21.15.104:3300/0 conn(0x7ff81406f1a0 0x7ff81406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7ff819f48640 1 -- 172.21.15.18:0/3474845012 >> 172.21.15.18:0/3474845012 conn(0x7ff8140b22b0 msgr2=0x7ff8140b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7f442ccc8640 1 -- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 msgr2=0x7f442806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7f442ccc8640 1 --2- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f442806ca30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44280682f0 tx=0x7f442002be70 comp rx=0 tx=0).stop 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7f257f59d640 1 -- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 msgr2=0x7f2564004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 -- 172.21.15.18:0/2921084115 shutdown_connections 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c039ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 --2- 172.21.15.18:0/2921084115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c038630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7fb318b46640 1 -- 172.21.15.18:0/2921084115 >> 172.21.15.18:0/2921084115 conn(0x7fb30c009fb0 msgr2=0x7fb30c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.663+0000 7f257f59d640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 0x7f2564004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2570009e60 tx=0x7f2564005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7fb318b46640 1 -- 172.21.15.18:0/2921084115 shutdown_connections 2024-04-16T12:55:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f257f59d640 1 -- 172.21.15.18:0/1841847505 shutdown_connections 2024-04-16T12:55:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f257f59d640 1 --2- 172.21.15.18:0/1841847505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2564004800 0x7f2564004c80 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2570009e60 tx=0x7f2564005830 comp rx=0 tx=0).stop 2024-04-16T12:55:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f257f59d640 1 -- 172.21.15.18:0/1841847505 >> 172.21.15.18:0/1841847505 conn(0x7f257806d320 msgr2=0x7f257806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7fb318b46640 1 -- 172.21.15.18:0/2921084115 wait complete. 2024-04-16T12:55:34.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7f15d4a8f640 1 -- 172.21.15.18:0/1743972422 shutdown_connections 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7f21c0dbd640 1 Processor -- start 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7f21c0dbd640 1 -- start start 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7ff819f48640 1 -- 172.21.15.18:0/3474845012 shutdown_connections 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7ff819f48640 1 -- 172.21.15.18:0/3474845012 wait complete. 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7ff819f48640 1 Processor -- start 2024-04-16T12:55:34.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7ff819f48640 1 -- start start 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 -- 172.21.15.18:0/2445667531 shutdown_connections 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 --2- 172.21.15.18:0/2445667531 >> v2:172.21.15.18:3300/0 conn(0x7f44280ae9f0 0x7f4428166a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 --2- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f442806cf70 0x7f44280ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 --2- 172.21.15.18:0/2445667531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f442806ca30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 -- 172.21.15.18:0/2445667531 >> 172.21.15.18:0/2445667531 conn(0x7f44280727a0 msgr2=0x7f4428072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 -- 172.21.15.18:0/2445667531 shutdown_connections 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.664+0000 7f442ccc8640 1 -- 172.21.15.18:0/2445667531 wait complete. 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.666+0000 7f442ccc8640 1 Processor -- start 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.666+0000 7f442ccc8640 1 -- start start 2024-04-16T12:55:34.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7fb318b46640 1 Processor -- start 2024-04-16T12:55:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.666+0000 7fb318b46640 1 -- start start 2024-04-16T12:55:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.666+0000 7f21c0dbd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.666+0000 7f21c0dbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 0x7f21bc15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.665+0000 7f15d4a8f640 1 -- 172.21.15.18:0/1743972422 wait complete. 2024-04-16T12:55:34.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f15d4a8f640 1 Processor -- start 2024-04-16T12:55:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21ba59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21ba59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56678/0 (socket says 172.21.15.18:56678) 2024-04-16T12:55:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21b9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 0x7f21bc15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21b9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 0x7f21bc15f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38994/0 (socket says 172.21.15.18:38994) 2024-04-16T12:55:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21ba59c640 1 -- 172.21.15.18:0/3215266629 learned_addr learned my addr 172.21.15.18:0/3215266629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21bc15d2f0 0x7f21bc15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8140b4ec0 0x7ff814168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 0x7ff814168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff81406cc40 con 0x7ff8140b4ec0 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff81406c960 con 0x7ff8140b5340 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819f48640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff81406cf20 con 0x7ff81406f1a0 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff818f46640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff813fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8140b4ec0 0x7ff814168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff818f46640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56694/0 (socket says 172.21.15.18:56694) 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff818f46640 1 -- 172.21.15.18:0/3034741283 learned_addr learned my addr 172.21.15.18:0/3034741283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7ff819747640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 0x7ff814168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f15d4a8f640 1 -- start start 2024-04-16T12:55:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc06ebf0 con 0x7f21bc06ceb0 2024-04-16T12:55:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc06e910 con 0x7f21bc15d2f0 2024-04-16T12:55:34.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f21bc06d320 con 0x7f21bc06ca30 2024-04-16T12:55:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c03a400 0x7fb30c0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c04a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c0e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c03a870 con 0x7fb30c03a400 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0503a0 con 0x7fb30c0e1090 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb318b46640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c006fa0 con 0x7fb30c050dd0 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb312ffd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c04a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb312ffd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c04a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56698/0 (socket says 172.21.15.18:56698) 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb312ffd640 1 -- 172.21.15.18:0/1158113586 learned_addr learned my addr 172.21.15.18:0/1158113586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f21bad9d640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21bc15d2f0 0x7f21bc15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7fb313fff640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c0e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 0x7f442809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f4428204750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4428164580 con 0x7f442806cf70 2024-04-16T12:55:34.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4428164400 con 0x7f4428164020 2024-04-16T12:55:34.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.667+0000 7f442ccc8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4428166fa0 con 0x7f44280ae9f0 2024-04-16T12:55:34.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f442659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f257f59d640 1 -- 172.21.15.18:0/1841847505 shutdown_connections 2024-04-16T12:55:34.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb3137fe640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c03a400 0x7fb30c0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f442659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39014/0 (socket says 172.21.15.18:39014) 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f442659c640 1 -- 172.21.15.18:0/401865475 learned_addr learned my addr 172.21.15.18:0/401865475 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f4425d9b640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 0x7f442809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f4426d9d640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f4428204750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 -- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 msgr2=0x7ff814168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 0x7ff814168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 -- 172.21.15.18:0/3034741283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8140b4ec0 msgr2=0x7ff814168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8140b4ec0 0x7ff814168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 -- 172.21.15.18:0/3034741283 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8141529d0 con 0x7ff81406f1a0 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff819747640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 0x7ff814168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 -- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21bc15d2f0 msgr2=0x7f21bc15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21bc15d2f0 0x7f21bc15fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 -- 172.21.15.18:0/3215266629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 msgr2=0x7f21bc15f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 0x7f21bc15f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc1651a0 con 0x7f21bc06ca30 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7ff818f46640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e9a0 tx=0x7ff80400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 0x7f15d0146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 0x7f15d0147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15d015b5b0 0x7f15d01e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0070050 con 0x7f15d00b5660 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15d006fed0 con 0x7f15d006ef00 2024-04-16T12:55:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f15d4a8f640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15d006c130 con 0x7f15d015b5b0 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f21ba59c640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21ac034040 tx=0x7f21ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 -- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 msgr2=0x7fb30c04a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c04a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 -- 172.21.15.18:0/1158113586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c03a400 msgr2=0x7fb30c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c03a400 0x7fb30c0cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 -- 172.21.15.18:0/1158113586 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c049750 con 0x7fb30c0e1090 2024-04-16T12:55:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7fb313fff640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c0e1e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb31406a4b0 tx=0x7fb314068e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140746e0 con 0x7fb30c0e1090 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 0x7f15d0146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 0x7f15d0146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55162/0 (socket says 172.21.15.18:55162) 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f15cf7fe640 1 -- 172.21.15.18:0/3297085766 learned_addr learned my addr 172.21.15.18:0/3297085766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140748a0 con 0x7fb30c0e1090 2024-04-16T12:55:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804017020 con 0x7ff81406f1a0 2024-04-16T12:55:34.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f15cffff640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15d015b5b0 0x7f15d01e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80400cc00 con 0x7ff81406f1a0 2024-04-16T12:55:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 -- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 msgr2=0x7f442809cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7ff819f48640 1 -- 172.21.15.18:0/3034741283 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff814152cb0 con 0x7ff81406f1a0 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7ff819f48640 1 -- 172.21.15.18:0/3034741283 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff814153270 con 0x7ff81406f1a0 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 0x7f442809cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 -- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 msgr2=0x7f4428204750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f4428204750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 -- 172.21.15.18:0/401865475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442809d3e0 con 0x7f442806cf70 2024-04-16T12:55:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8040113f0 con 0x7ff81406f1a0 2024-04-16T12:55:34.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f4425d9b640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 0x7f442809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f4426d9d640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f4428204750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:34.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314093400 con 0x7fb30c0e1090 2024-04-16T12:55:34.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.668+0000 7f257f59d640 1 -- 172.21.15.18:0/1841847505 wait complete. 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f15ceffd640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 0x7f15d0147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 -- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15d015b5b0 msgr2=0x7f15d01e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15d015b5b0 0x7f15d01e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 -- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 msgr2=0x7f15d0146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 0x7f15d0146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 -- 172.21.15.18:0/3297085766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d0146fb0 con 0x7f15d00b5660 2024-04-16T12:55:34.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c049a30 con 0x7fb30c0e1090 2024-04-16T12:55:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0315a0 con 0x7f21bc06ca30 2024-04-16T12:55:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac032700 con 0x7f21bc06ca30 2024-04-16T12:55:34.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f15ceffd640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 0x7f15d0147f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c390 tx=0x7f15c000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21bc1654e0 con 0x7f21bc06ca30 2024-04-16T12:55:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21bc165d20 con 0x7f21bc06ca30 2024-04-16T12:55:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c049ff0 con 0x7fb30c0e1090 2024-04-16T12:55:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0017070 con 0x7f15d00b5660 2024-04-16T12:55:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f257f59d640 1 Processor -- start 2024-04-16T12:55:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac032af0 con 0x7f21bc06ca30 2024-04-16T12:55:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d0147290 con 0x7f15d00b5660 2024-04-16T12:55:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d0147850 con 0x7f15d00b5660 2024-04-16T12:55:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c00052d0 con 0x7f15d00b5660 2024-04-16T12:55:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0003830 con 0x7f15d00b5660 2024-04-16T12:55:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff80401a020 con 0x7ff81406f1a0 2024-04-16T12:55:34.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7fb2fdffb640 1 -- 172.21.15.18:0/1158113586 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ec005290 con 0x7fb30c0e1090 2024-04-16T12:55:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7ff6f1477640 1 Processor -- start 2024-04-16T12:55:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7ff6f1477640 1 -- start start 2024-04-16T12:55:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7ff8117fa640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 0x7ff80006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.669+0000 7f442659c640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4420000f80 tx=0x7f4420004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420043020 con 0x7f442806cf70 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44282052a0 con 0x7f442806cf70 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.670+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442809d880 con 0x7f442806cf70 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442002ca40 con 0x7f442806cf70 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.671+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442003e690 con 0x7f442806cf70 2024-04-16T12:55:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.672+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c005290 con 0x7f442806cf70 2024-04-16T12:55:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3140935c0 con 0x7fb30c0e1090 2024-04-16T12:55:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7ff813fff640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 0x7ff80006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff80408bb50 con 0x7ff81406f1a0 2024-04-16T12:55:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21bc0752b0 con 0x7f21bc06ca30 2024-04-16T12:55:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f5bb3f59640 1 Processor -- start 2024-04-16T12:55:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f257f59d640 1 -- start start 2024-04-16T12:55:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f5bb3f59640 1 -- start start 2024-04-16T12:55:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7ff819f48640 1 -- 172.21.15.18:0/3034741283 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4005290 con 0x7ff81406f1a0 2024-04-16T12:55:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7ff6f1477640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff6ec15ea70 0x7ff6ec0d2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6f1477640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7fb2fffff640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 0x7fb2f806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6f1477640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ec15ee50 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6f1477640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ec0d3f40 con 0x7ff6ec15ea70 2024-04-16T12:55:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6f1477640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ec0d3330 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257815d070 0x7f25780cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55176/0 (socket says 172.21.15.18:55176) 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 -- 172.21.15.18:0/2013718728 learned_addr learned my addr 172.21.15.18:0/2013718728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25780b89b0 0x7f25781fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257dd9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257dd9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:55188/0 (socket says 172.21.15.18:55188) 2024-04-16T12:55:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257dd9a640 1 -- 172.21.15.18:0/4162751957 learned_addr learned my addr 172.21.15.18:0/4162751957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21ac04c060 con 0x7f21bc06ca30 2024-04-16T12:55:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f21aaffd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 0x7f219c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f21ac0ad7f0 con 0x7f21bc06ca30 2024-04-16T12:55:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25780d0d80 con 0x7f257815d070 2024-04-16T12:55:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2578163b90 con 0x7f25780cb160 2024-04-16T12:55:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f25780d0f00 con 0x7f25780b89b0 2024-04-16T12:55:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.673+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b0005290 con 0x7f15d00b5660 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f5bb3f59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f5bb3f59640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5bac09b120 0x7f5bac0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f5bb3f59640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bac15dd40 con 0x7f5bac0d0200 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f5bb3f59640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac0d12d0 con 0x7f5bac09b120 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7f5bb3f59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac0d06c0 con 0x7f5bac15a4d0 2024-04-16T12:55:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 -- 172.21.15.18:0/2013718728 >> v2:172.21.15.18:3300/0 conn(0x7ff6ec15ea70 msgr2=0x7ff6ec0d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 --2- 172.21.15.18:0/2013718728 >> v2:172.21.15.18:3300/0 conn(0x7ff6ec15ea70 0x7ff6ec0d2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.674+0000 7ff6eb7fe640 1 -- 172.21.15.18:0/2013718728 >> v1:172.21.15.104:6789/0 conn(0x7ff6ec0d2e40 legacy=0x7ff6ec0d1290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:55:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257e59b640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257815d070 0x7f25780cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7ff6eb7fe640 1 -- 172.21.15.18:0/2013718728 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0d3610 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f21b9d9b640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 0x7f219c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb314107150 con 0x7fb30c0e1090 2024-04-16T12:55:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4420046020 con 0x7f442806cf70 2024-04-16T12:55:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7fb3137fe640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 0x7fb2f806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 -- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25780b89b0 msgr2=0x7f25781fbf60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T12:55:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25780b89b0 0x7f25781fbf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 -- 172.21.15.18:0/4162751957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257815d070 msgr2=0x7f25780cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257815d070 0x7f25780cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25780b9210 con 0x7f25780cb160 2024-04-16T12:55:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:56738/0 (socket says 172.21.15.18:56738) 2024-04-16T12:55:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 -- 172.21.15.18:0/1020307487 learned_addr learned my addr 172.21.15.18:0/1020307487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f257dd9a640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f80 tx=0x7f2570004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7ff813fff640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 0x7ff80006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff80c035000 tx=0x7ff80c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f4416ffd640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 0x7f440806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 -- 172.21.15.18:0/1020307487 >> v2:172.21.15.104:3300/0 conn(0x7f5bac09b120 msgr2=0x7f5bac0cd2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T12:55:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 --2- 172.21.15.18:0/1020307487 >> v2:172.21.15.104:3300/0 conn(0x7f5bac09b120 0x7f5bac0cd2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 -- 172.21.15.18:0/1020307487 >> v1:172.21.15.18:6789/0 conn(0x7f5bac0d0200 legacy=0x7f5bac09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7fb3137fe640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 0x7fb2f806eeb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb308036000 tx=0x7fb30803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44200ae960 con 0x7f442806cf70 2024-04-16T12:55:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f4425d9b640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 0x7f440806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7ff6eb7fe640 1 --2- 172.21.15.18:0/2013718728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b71e0 tx=0x7ff6e402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f9d262cee34b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.675+0000 7f5bb1cf5640 1 -- 172.21.15.18:0/1020307487 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac0d09a0 con 0x7f5bac15a4d0 2024-04-16T12:55:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f21b9d9b640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 0x7f219c06ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21bc158ca0 tx=0x7f21b00079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15c001a070 con 0x7f15d00b5660 2024-04-16T12:55:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f4425d9b640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 0x7f440806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f44281f81c0 tx=0x7f4418008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f15b7fff640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 0x7f15bc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15c008b190 con 0x7f15d00b5660 2024-04-16T12:55:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f15cf7fe640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 0x7f15bc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.676+0000 7f5bb1cf5640 1 --2- 172.21.15.18:0/1020307487 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009e50 tx=0x7f5ba402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3963199c4cee9eb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.677+0000 7f15cf7fe640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 0x7f15bc06ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15c802e2e0 tx=0x7f15c800a040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570044020 con 0x7f25780cb160 2024-04-16T12:55:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7ff6e9ffb640 1 -- 172.21.15.18:0/2013718728 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402ca70 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257003f470 con 0x7f25780cb160 2024-04-16T12:55:34.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570039040 con 0x7f25780cb160 2024-04-16T12:55:34.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7ff6e9ffb640 1 -- 172.21.15.18:0/2013718728 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e402cc10 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7ff6e9ffb640 1 -- 172.21.15.18:0/2013718728 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40343f0 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25780b94f0 con 0x7f25780cb160 2024-04-16T12:55:34.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.678+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb31408f030 con 0x7fb30c0e1090 2024-04-16T12:55:34.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25780b9ab0 con 0x7f25780cb160 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 -- 172.21.15.18:0/2013718728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec0d19a0 msgr2=0x7ff6ec0b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 --2- 172.21.15.18:0/2013718728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b71e0 tx=0x7ff6e402bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 -- 172.21.15.18:0/2013718728 shutdown_connections 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 --2- 172.21.15.18:0/2013718728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec0d19a0 0x7ff6ec0b79b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 --2- 172.21.15.18:0/2013718728 >> v2:172.21.15.18:3300/0 conn(0x7ff6ec15ea70 0x7ff6ec0d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.679+0000 7ff6f1477640 1 -- 172.21.15.18:0/2013718728 >> 172.21.15.18:0/2013718728 conn(0x7ff6ec06d460 msgr2=0x7ff6ec0b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.680+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff804021070 con 0x7ff81406f1a0 2024-04-16T12:55:34.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.680+0000 7ff6f1477640 1 -- 172.21.15.18:0/2013718728 shutdown_connections 2024-04-16T12:55:34.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.680+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257804fd90 con 0x7f25780cb160 2024-04-16T12:55:34.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.680+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2570047020 con 0x7f25780cb160 2024-04-16T12:55:34.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.680+0000 7ff6f1477640 1 -- 172.21.15.18:0/2013718728 wait complete. 2024-04-16T12:55:34.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.681+0000 7f256effd640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 0x7f255c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.681+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f442004d030 con 0x7f442806cf70 2024-04-16T12:55:34.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.681+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25700aea20 con 0x7f25780cb160 2024-04-16T12:55:34.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.681+0000 7f257e59b640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 0x7f255c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.682+0000 7f257e59b640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 0x7f255c06ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2574006fd0 tx=0x7f2574008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.683+0000 7ff6f1477640 1 Processor -- start 2024-04-16T12:55:34.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.683+0000 7ff6f1477640 1 -- start start 2024-04-16T12:55:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7ff6f1477640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6ec0d19a0 0x7ff6ec1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7ff6f1477640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7f5bb0cf3640 1 -- 172.21.15.18:0/1020307487 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba402caa0 con 0x7f5bac15a4d0 2024-04-16T12:55:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7f5bb0cf3640 1 -- 172.21.15.18:0/1020307487 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba402cc40 con 0x7f5bac15a4d0 2024-04-16T12:55:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7f5bb0cf3640 1 -- 172.21.15.18:0/1020307487 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40343f0 con 0x7f5bac15a4d0 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7ff6f1477640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec15ea70 0x7ff6ec1496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.684+0000 7ff6ea7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6f1477640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0ba680 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39050/0 (socket says 172.21.15.18:39050) 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 -- 172.21.15.18:0/1555979156 learned_addr learned my addr 172.21.15.18:0/1555979156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6f1477640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0d3bd0 con 0x7ff6ec15ea70 2024-04-16T12:55:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6f1477640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec0ba800 con 0x7ff6ec0d19a0 2024-04-16T12:55:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21bc1654e0 con 0x7f21bc06ca30 2024-04-16T12:55:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 -- 172.21.15.18:0/1020307487 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 msgr2=0x7f5bac15d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6eaffd640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6ec0d19a0 0x7ff6ec1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/1020307487 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009e50 tx=0x7f5ba402bf00 comp rx=0 tx=0).stop 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 -- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6ec0d19a0 msgr2=0x7ff6ec1f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6ec0d19a0 0x7ff6ec1f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 -- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec15ea70 msgr2=0x7ff6ec1496b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 -- 172.21.15.18:0/1020307487 shutdown_connections 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/1020307487 >> v2:172.21.15.104:3300/0 conn(0x7f5bac09b120 0x7f5bac0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/1020307487 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac15d800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7f5bb3f59640 1 -- 172.21.15.18:0/1020307487 >> 172.21.15.18:0/1020307487 conn(0x7f5bac0d2630 msgr2=0x7f5bac0d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec15ea70 0x7ff6ec1496b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.685+0000 7ff6ea7fc640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0ccf10 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.686+0000 7ff6ea7fc640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b450 tx=0x7ff6dc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.686+0000 7f5bb3f59640 1 -- 172.21.15.18:0/1020307487 shutdown_connections 2024-04-16T12:55:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.686+0000 7f5bb3f59640 1 -- 172.21.15.18:0/1020307487 wait complete. 2024-04-16T12:55:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.686+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f257004e020 con 0x7f25780cb160 2024-04-16T12:55:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.688+0000 7f5bb3f59640 1 Processor -- start 2024-04-16T12:55:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.688+0000 7f5bb3f59640 1 -- start start 2024-04-16T12:55:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.689+0000 7f5bb3f59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.689+0000 7f5bb3f59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 0x7f5bac15ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.689+0000 7f5bb1cf5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb1cf5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39064/0 (socket says 172.21.15.18:39064) 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb1cf5640 1 -- 172.21.15.18:0/3596204188 learned_addr learned my addr 172.21.15.18:0/3596204188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac0cd810 con 0x7f5bac09b120 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac0d0f60 con 0x7f5bac0d0200 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac0cd990 con 0x7f5bac15a4d0 2024-04-16T12:55:34.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15c0058c10 con 0x7f15d00b5660 2024-04-16T12:55:34.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb24f6640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.690+0000 7f5bb14f4640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 0x7f5bac15ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 -- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 msgr2=0x7f5bac158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 -- 172.21.15.18:0/3596204188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 msgr2=0x7f5bac0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac15f0f0 con 0x7f5bac0d0200 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb1cf5640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.691+0000 7f5bb14f4640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 0x7f5bac15ebb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800c3c0 tx=0x7f5ba800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8017070 con 0x7f5bac0d0200 2024-04-16T12:55:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc015020 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7ff6f1477640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec0cd1f0 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc011890 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc015020 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.692+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba80052d0 con 0x7f5bac0d0200 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.693+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8017070 con 0x7f5bac0d0200 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.693+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac15f390 con 0x7f5bac0d0200 2024-04-16T12:55:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.693+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac15f950 con 0x7f5bac0d0200 2024-04-16T12:55:34.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.693+0000 7ff6f1477640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec0cda90 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.695+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ba801a070 con 0x7f5bac0d0200 2024-04-16T12:55:34.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.697+0000 7f5ba27fc640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 0x7f5b9006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.698+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac0752b0 con 0x7f5bac0d0200 2024-04-16T12:55:34.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.698+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5ba80050d0 con 0x7f5bac0d0200 2024-04-16T12:55:34.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.696+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6dc018020 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.696+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec0cd3c0 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.697+0000 7ff6d37fe640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 0x7ff6d806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:34.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.700+0000 7ff6eaffd640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 0x7ff6d806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.700+0000 7f5bb1cf5640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 0x7f5b9006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.700+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff6dc011690 con 0x7ff6ec0d2e40 2024-04-16T12:55:34.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.701+0000 7f5bb1cf5640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 0x7f5b9006f1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0706b0 tx=0x7f5ba4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.702+0000 7ff6eaffd640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 0x7ff6d806f1b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098e0 tx=0x7ff6e0009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.703+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ba8058470 con 0x7f5bac0d0200 2024-04-16T12:55:34.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:34.710+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff6dc091030 con 0x7ff6ec0d2e40 2024-04-16T12:55:35.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.105+0000 7ff819f48640 1 -- 172.21.15.18:0/3034741283 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff7f4005580 con 0x7ff81406f1a0 2024-04-16T12:55:35.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.106+0000 7ff8117fa640 1 -- 172.21.15.18:0/3034741283 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8040595d0 con 0x7ff81406f1a0 2024-04-16T12:55:35.108 INFO:teuthology.orchestra.run.smithi018.stdout:55834574858 2024-04-16T12:55:35.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f440c005850 con 0x7f442806cf70 2024-04-16T12:55:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 msgr2=0x7ff80006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 0x7ff80006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff80c035000 tx=0x7ff80c030000 comp rx=0 tx=0).stop 2024-04-16T12:55:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 msgr2=0x7ff814155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e9a0 tx=0x7ff80400ee60 comp rx=0 tx=0).stop 2024-04-16T12:55:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.109+0000 7f4416ffd640 1 -- 172.21.15.18:0/401865475 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f442007cce0 con 0x7f442806cf70 2024-04-16T12:55:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 shutdown_connections 2024-04-16T12:55:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff80006c9c0 0x7ff80006ee80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8140b5340 0x7ff814168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8140b4ec0 0x7ff814168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 --2- 172.21.15.18:0/3034741283 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff81406f1a0 0x7ff814155ec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 >> 172.21.15.18:0/3034741283 conn(0x7ff8140b22b0 msgr2=0x7ff8140ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.113 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-16T12:55:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 shutdown_connections 2024-04-16T12:55:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.110+0000 7ff7faffd640 1 -- 172.21.15.18:0/3034741283 wait complete. 2024-04-16T12:55:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.111+0000 7fb2fdffb640 1 -- 172.21.15.18:0/1158113586 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb2ec005580 con 0x7fb30c0e1090 2024-04-16T12:55:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.111+0000 7fb2fffff640 1 -- 172.21.15.18:0/1158113586 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3140d52b0 con 0x7fb30c0e1090 2024-04-16T12:55:35.114 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2024-04-16T12:55:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.113+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 msgr2=0x7f440806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.113+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 0x7f440806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f44281f81c0 tx=0x7f4418008040 comp rx=0 tx=0).stop 2024-04-16T12:55:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 msgr2=0x7f442809e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4420000f80 tx=0x7f4420004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 shutdown_connections 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f440806c8f0 0x7f440806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4428164020 0x7f4428204750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f44280ae9f0 0x7f442809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.114+0000 7f442ccc8640 1 --2- 172.21.15.18:0/401865475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442806cf70 0x7f442809e360 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 >> 172.21.15.18:0/401865475 conn(0x7f44280727a0 msgr2=0x7f44280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 shutdown_connections 2024-04-16T12:55:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 msgr2=0x7fb2f806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 0x7fb2f806eeb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb308036000 tx=0x7fb30803c040 comp rx=0 tx=0).stop 2024-04-16T12:55:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 msgr2=0x7fb30c0e1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7f442ccc8640 1 -- 172.21.15.18:0/401865475 wait complete. 2024-04-16T12:55:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c0e1e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb31406a4b0 tx=0x7fb314068e40 comp rx=0 tx=0).stop 2024-04-16T12:55:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 shutdown_connections 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb2f806c9f0 0x7fb2f806eeb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb30c0e1090 0x7fb30c0e1e80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb30c050dd0 0x7fb30c04a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 --2- 172.21.15.18:0/1158113586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30c03a400 0x7fb30c0cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.115+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 >> 172.21.15.18:0/1158113586 conn(0x7fb30c009fb0 msgr2=0x7fb30c004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.116+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 shutdown_connections 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.116+0000 7fb318b46640 1 -- 172.21.15.18:0/1158113586 wait complete. 2024-04-16T12:55:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.117+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f21bc06f1a0 con 0x7f21bc06ca30 2024-04-16T12:55:35.121 INFO:teuthology.orchestra.run.smithi018.stdout:55834574859 2024-04-16T12:55:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.118+0000 7f21aaffd640 1 -- 172.21.15.18:0/3215266629 <== mon.2 v2:172.21.15.104:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21ac040070 con 0x7f21bc06ca30 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.122+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 msgr2=0x7f219c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.122+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 0x7f219c06ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21bc158ca0 tx=0x7f21b00079d0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.122+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 msgr2=0x7f21bc15bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.122+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21ac034040 tx=0x7f21ac0046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.122+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 shutdown_connections 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f219c06c9c0 0x7f219c06ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21bc15d2f0 0x7f21bc15fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21bc06ceb0 0x7f21bc15f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 --2- 172.21.15.18:0/3215266629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21bc06ca30 0x7f21bc15bb90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f257806c420 con 0x7f25780cb160 2024-04-16T12:55:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 >> 172.21.15.18:0/3215266629 conn(0x7f21bc0b2940 msgr2=0x7f21bc0b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 shutdown_connections 2024-04-16T12:55:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.123+0000 7f21c0dbd640 1 -- 172.21.15.18:0/3215266629 wait complete. 2024-04-16T12:55:35.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.124+0000 7f256effd640 1 -- 172.21.15.18:0/4162751957 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2570008030 con 0x7f25780cb160 2024-04-16T12:55:35.127 INFO:teuthology.orchestra.run.smithi018.stdout:55834574858 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 msgr2=0x7f255c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 0x7f255c06ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2574006fd0 tx=0x7f2574008040 comp rx=0 tx=0).stop 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 msgr2=0x7f25780b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2570009f80 tx=0x7f2570004a80 comp rx=0 tx=0).stop 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 shutdown_connections 2024-04-16T12:55:35.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f255c06c920 0x7f255c06ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f25780b89b0 0x7f25781fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25780cb160 0x7f25780b8470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 --2- 172.21.15.18:0/4162751957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f257815d070 0x7f25780cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 >> 172.21.15.18:0/4162751957 conn(0x7f257806d320 msgr2=0x7f2578164590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 shutdown_connections 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.127+0000 7f257f59d640 1 -- 172.21.15.18:0/4162751957 wait complete. 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.128+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f15b0005580 con 0x7f15d00b5660 2024-04-16T12:55:35.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.128+0000 7f15b7fff640 1 -- 172.21.15.18:0/3297085766 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15c005cf10 con 0x7f15d00b5660 2024-04-16T12:55:35.131 INFO:teuthology.orchestra.run.smithi018.stdout:55834574857 2024-04-16T12:55:35.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-16T12:55:35.132 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.131+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5bac0b85b0 con 0x7f5bac0d0200 2024-04-16T12:55:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 msgr2=0x7f15bc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f5ba27fc640 1 -- 172.21.15.18:0/3596204188 <== mon.1 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ba805c770 con 0x7f5bac0d0200 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 0x7f15bc06ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15c802e2e0 tx=0x7f15c800a040 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 msgr2=0x7f15d0147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 0x7f15d0147f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c390 tx=0x7f15c000c850 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 shutdown_connections 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15bc06c9c0 0x7f15bc06ee80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15d015b5b0 0x7f15d01e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d00b5660 0x7f15d0147f50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 --2- 172.21.15.18:0/3297085766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d006ef00 0x7f15d0146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.132+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 >> 172.21.15.18:0/3297085766 conn(0x7f15d00b24f0 msgr2=0x7f15d0159020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.135 INFO:teuthology.orchestra.run.smithi018.stdout:55834574857 2024-04-16T12:55:35.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.133+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 shutdown_connections 2024-04-16T12:55:35.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.133+0000 7f15d4a8f640 1 -- 172.21.15.18:0/3297085766 wait complete. 2024-04-16T12:55:35.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-04-16T12:55:35.138 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 msgr2=0x7f5b9006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 0x7f5b9006f1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0706b0 tx=0x7f5ba4030000 comp rx=0 tx=0).stop 2024-04-16T12:55:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 msgr2=0x7f5bac15ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 0x7f5bac15ebb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800c3c0 tx=0x7f5ba800c880 comp rx=0 tx=0).stop 2024-04-16T12:55:35.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 shutdown_connections 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5b9006ccf0 0x7f5b9006f1b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bac15a4d0 0x7f5bac158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bac0d0200 0x7f5bac15ebb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 --2- 172.21.15.18:0/3596204188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bac09b120 0x7f5bac0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 >> 172.21.15.18:0/3596204188 conn(0x7f5bac0d2630 msgr2=0x7f5bac15c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 shutdown_connections 2024-04-16T12:55:35.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.136+0000 7f5bb3f59640 1 -- 172.21.15.18:0/3596204188 wait complete. 2024-04-16T12:55:35.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2024-04-16T12:55:35.140 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.142+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff6ec0cdc90 con 0x7ff6ec0d2e40 2024-04-16T12:55:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.142+0000 7ff6d37fe640 1 -- 172.21.15.18:0/1555979156 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6ec0cdc90 con 0x7ff6ec0d2e40 2024-04-16T12:55:35.145 INFO:teuthology.orchestra.run.smithi018.stdout:60129542156 2024-04-16T12:55:35.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-16T12:55:35.145 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-16T12:55:35.146 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 msgr2=0x7ff6d806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 0x7ff6d806f1b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098e0 tx=0x7ff6e0009060 comp rx=0 tx=0).stop 2024-04-16T12:55:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 msgr2=0x7ff6ec0cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b450 tx=0x7ff6dc00b910 comp rx=0 tx=0).stop 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 shutdown_connections 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff6d806ccf0 0x7ff6d806f1b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6ec15ea70 0x7ff6ec1496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6ec0d2e40 0x7ff6ec0cdfb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 --2- 172.21.15.18:0/1555979156 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff6ec0d19a0 0x7ff6ec1f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 >> 172.21.15.18:0/1555979156 conn(0x7ff6ec06d460 msgr2=0x7ff6ec0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 shutdown_connections 2024-04-16T12:55:35.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.146+0000 7ff6d17fa640 1 -- 172.21.15.18:0/1555979156 wait complete. 2024-04-16T12:55:35.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-16T12:55:35.157 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-16T12:55:35.157 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.7 2024-04-16T12:55:35.160 DEBUG:teuthology.parallel:result is None 2024-04-16T12:55:35.160 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T12:55:35.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:55:35.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.303+0000 7f83838d3640 1 Processor -- start 2024-04-16T12:55:35.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.303+0000 7f83838d3640 1 -- start start 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f83838d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f837c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f83838d3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837c15cc00 con 0x7f837c0ccd80 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f83838d3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837c160a30 con 0x7f837c0b48c0 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f83838d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f837c160d10 con 0x7f837c15c820 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8380e6e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f837c0ccd80 0x7f837c0b41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37074/0 (socket says 172.21.15.18:37074) 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8380e6e640 1 -- 172.21.15.18:0/3927598502 learned_addr learned my addr 172.21.15.18:0/3927598502 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f838166f640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f837c1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168366028 0 0) 0x7f837c15cc00 con 0x7f837c0ccd80 2024-04-16T12:55:35.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8368003520 con 0x7f837c0ccd80 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2173546087 0 0) 0x7f8368003520 con 0x7f837c0ccd80 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 msgr2=0x7f837c1603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f837c1603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 >> v1:172.21.15.104:6789/0 conn(0x7f837c0b48c0 legacy=0x7f837c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c160ff0 con 0x7f837c0ccd80 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f836c001670 con 0x7f837c0ccd80 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 >> v1:172.21.15.18:6789/0 conn(0x7f837c0ccd80 legacy=0x7f837c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f83680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f8368004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8368004d40 0x7f83680051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f837c160d10 con 0x7f8368003fb0 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f836800bc50 con 0x7f8368004d40 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.304+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f836800be50 con 0x7f837c15c820 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f8368004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f838166f640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f83680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8381e70640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8368004d40 0x7f83680051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 -- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 msgr2=0x7f83680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c15c820 0x7f83680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 -- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8368004d40 msgr2=0x7f83680051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8368004d40 0x7f83680051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.305+0000 7f8380e6e640 1 -- 172.21.15.18:0/3927598502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368003520 con 0x7f8368003fb0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f8380e6e640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f8368004800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c190 tx=0x7f8368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974974f2d2168df8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c007c60 con 0x7f8368003fb0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836c030070 con 0x7f8368003fb0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f8373fff640 1 -- 172.21.15.18:0/3927598502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c005db0 con 0x7f8368003fb0 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 -- 172.21.15.18:0/3927598502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 msgr2=0x7f8368004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 --2- 172.21.15.18:0/3927598502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f8368004800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c190 tx=0x7f8368005830 comp rx=0 tx=0).stop 2024-04-16T12:55:35.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f8381e70640 1 -- 172.21.15.18:0/3927598502 reap_dead start 2024-04-16T12:55:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 -- 172.21.15.18:0/3927598502 shutdown_connections 2024-04-16T12:55:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 -- 172.21.15.18:0/3927598502 >> 172.21.15.18:0/3927598502 conn(0x7f837c0cf1b0 msgr2=0x7f837c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 -- 172.21.15.18:0/3927598502 shutdown_connections 2024-04-16T12:55:35.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.306+0000 7f83838d3640 1 -- 172.21.15.18:0/3927598502 wait complete. 2024-04-16T12:55:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.307+0000 7f83838d3640 1 Processor -- start 2024-04-16T12:55:35.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 -- start start 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f837c153c20 0x7f837c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c0b6a40 0x7f837c0b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1603c0 con 0x7f8368003fb0 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f837c0b8260 con 0x7f837c153c20 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f83838d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f837c160540 con 0x7f837c0b6a40 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f838166f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f838166f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39080/0 (socket says 172.21.15.18:39080) 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f838166f640 1 -- 172.21.15.18:0/1050497438 learned_addr learned my addr 172.21.15.18:0/1050497438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f8381e70640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c0b6a40 0x7f837c0b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.308+0000 7f8380e6e640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f837c153c20 0x7f837c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 -- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c0b6a40 msgr2=0x7f837c0b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c0b6a40 0x7f837c0b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 -- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f837c153c20 msgr2=0x7f837c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f837c153c20 0x7f837c0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 -- 172.21.15.18:0/1050497438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c0cac70 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f838166f640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8378011e30 tx=0x7f837800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378015630 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83780157d0 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378015ba0 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c0caf50 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.309+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c0c7c00 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.310+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837c068a70 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.311+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f837801d400 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.311+0000 7f8371ffb640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 0x7f836006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.311+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f837808cef0 con 0x7f8368003fb0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.311+0000 7f8380e6e640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 0x7f836006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.312+0000 7f8380e6e640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 0x7f836006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c160 tx=0x7f836c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.315+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8378019030 con 0x7f8368003fb0 2024-04-16T12:55:35.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.502+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f837c0cc710 con 0x7f836006c8f0 2024-04-16T12:55:35.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.510+0000 7f8371ffb640 1 -- 172.21.15.18:0/1050497438 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332529 (secure 0 0 0) 0x7f836c096310 con 0x7f836006c8f0 2024-04-16T12:55:35.518 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:35.521 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 msgr2=0x7f836006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 0x7f836006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c160 tx=0x7f836c009030 comp rx=0 tx=0).stop 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 msgr2=0x7f837c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8378011e30 tx=0x7f837800f580 comp rx=0 tx=0).stop 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 shutdown_connections 2024-04-16T12:55:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f836006c8f0 0x7f836006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f837c0b6a40 0x7f837c0b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f837c153c20 0x7f837c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 --2- 172.21.15.18:0/1050497438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8368003fb0 0x7f837c1530b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 >> 172.21.15.18:0/1050497438 conn(0x7f837c0cf1b0 msgr2=0x7f837c15be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 shutdown_connections 2024-04-16T12:55:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.514+0000 7f83838d3640 1 -- 172.21.15.18:0/1050497438 wait complete. 2024-04-16T12:55:35.527 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-16T12:55:34.525012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231816,"kb_used_data":3176,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742904,"statfs":{"total":773094113280,"available":772856733696,"internally_reserved":0,"allocated":3252224,"data_stored":1985344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367479+0000","last_change":"2024-04-16T12:55:08.601362+0000","last_active":"2024-04-16T12:55:16.367479+0000","last_peered":"2024-04-16T12:55:16.367479+0000","last_clean":"2024-04-16T12:55:16.367479+0000","last_became_active":"2024-04-16T12:55:08.601067+0000","last_became_peered":"2024-04-16T12:55:08.601067+0000","last_unstale":"2024-04-16T12:55:16.367479+0000","last_undegraded":"2024-04-16T12:55:16.367479+0000","last_fullsized":"2024-04-16T12:55:16.367479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695218+0000","last_change":"2024-04-16T12:55:09.615816+0000","last_active":"2024-04-16T12:55:14.695218+0000","last_peered":"2024-04-16T12:55:14.695218+0000","last_clean":"2024-04-16T12:55:14.695218+0000","last_became_active":"2024-04-16T12:55:09.615467+0000","last_became_peered":"2024-04-16T12:55:09.615467+0000","last_unstale":"2024-04-16T12:55:14.695218+0000","last_undegraded":"2024-04-16T12:55:14.695218+0000","last_fullsized":"2024-04-16T12:55:14.695218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694776+0000","last_change":"2024-04-16T12:55:13.983588+0000","last_active":"2024-04-16T12:55:14.694776+0000","last_peered":"2024-04-16T12:55:14.694776+0000","last_clean":"2024-04-16T12:55:14.694776+0000","last_became_active":"2024-04-16T12:55:13.982853+0000","last_became_peered":"2024-04-16T12:55:13.982853+0000","last_unstale":"2024-04-16T12:55:14.694776+0000","last_undegraded":"2024-04-16T12:55:14.694776+0000","last_fullsized":"2024-04-16T12:55:14.694776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695423+0000","last_change":"2024-04-16T12:55:08.604046+0000","last_active":"2024-04-16T12:55:14.695423+0000","last_peered":"2024-04-16T12:55:14.695423+0000","last_clean":"2024-04-16T12:55:14.695423+0000","last_became_active":"2024-04-16T12:55:08.603686+0000","last_became_peered":"2024-04-16T12:55:08.603686+0000","last_unstale":"2024-04-16T12:55:14.695423+0000","last_undegraded":"2024-04-16T12:55:14.695423+0000","last_fullsized":"2024-04-16T12:55:14.695423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:09.977524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367376+0000","last_change":"2024-04-16T12:55:09.603388+0000","last_active":"2024-04-16T12:55:16.367376+0000","last_peered":"2024-04-16T12:55:16.367376+0000","last_clean":"2024-04-16T12:55:16.367376+0000","last_became_active":"2024-04-16T12:55:09.603127+0000","last_became_peered":"2024-04-16T12:55:09.603127+0000","last_unstale":"2024-04-16T12:55:16.367376+0000","last_undegraded":"2024-04-16T12:55:16.367376+0000","last_fullsized":"2024-04-16T12:55:16.367376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368880+0000","last_change":"2024-04-16T12:55:13.640798+0000","last_active":"2024-04-16T12:55:16.368880+0000","last_peered":"2024-04-16T12:55:16.368880+0000","last_clean":"2024-04-16T12:55:16.368880+0000","last_became_active":"2024-04-16T12:55:13.640396+0000","last_became_peered":"2024-04-16T12:55:13.640396+0000","last_unstale":"2024-04-16T12:55:16.368880+0000","last_undegraded":"2024-04-16T12:55:16.368880+0000","last_fullsized":"2024-04-16T12:55:16.368880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:30.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368816+0000","last_change":"2024-04-16T12:55:08.603812+0000","last_active":"2024-04-16T12:55:16.368816+0000","last_peered":"2024-04-16T12:55:16.368816+0000","last_clean":"2024-04-16T12:55:16.368816+0000","last_became_active":"2024-04-16T12:55:08.603521+0000","last_became_peered":"2024-04-16T12:55:08.603521+0000","last_unstale":"2024-04-16T12:55:16.368816+0000","last_undegraded":"2024-04-16T12:55:16.368816+0000","last_fullsized":"2024-04-16T12:55:16.368816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:29.707733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633822+0000","last_change":"2024-04-16T12:55:09.599628+0000","last_active":"2024-04-16T12:55:14.633822+0000","last_peered":"2024-04-16T12:55:14.633822+0000","last_clean":"2024-04-16T12:55:14.633822+0000","last_became_active":"2024-04-16T12:55:09.599322+0000","last_became_peered":"2024-04-16T12:55:09.599322+0000","last_unstale":"2024-04-16T12:55:14.633822+0000","last_undegraded":"2024-04-16T12:55:14.633822+0000","last_fullsized":"2024-04-16T12:55:14.633822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369484+0000","last_change":"2024-04-16T12:55:13.644781+0000","last_active":"2024-04-16T12:55:16.369484+0000","last_peered":"2024-04-16T12:55:16.369484+0000","last_clean":"2024-04-16T12:55:16.369484+0000","last_became_active":"2024-04-16T12:55:13.644284+0000","last_became_peered":"2024-04-16T12:55:13.644284+0000","last_unstale":"2024-04-16T12:55:16.369484+0000","last_undegraded":"2024-04-16T12:55:16.369484+0000","last_fullsized":"2024-04-16T12:55:16.369484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367966+0000","last_change":"2024-04-16T12:55:08.606441+0000","last_active":"2024-04-16T12:55:16.367966+0000","last_peered":"2024-04-16T12:55:16.367966+0000","last_clean":"2024-04-16T12:55:16.367966+0000","last_became_active":"2024-04-16T12:55:08.606162+0000","last_became_peered":"2024-04-16T12:55:08.606162+0000","last_unstale":"2024-04-16T12:55:16.367966+0000","last_undegraded":"2024-04-16T12:55:16.367966+0000","last_fullsized":"2024-04-16T12:55:16.367966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634055+0000","last_change":"2024-04-16T12:55:09.605124+0000","last_active":"2024-04-16T12:55:14.634055+0000","last_peered":"2024-04-16T12:55:14.634055+0000","last_clean":"2024-04-16T12:55:14.634055+0000","last_became_active":"2024-04-16T12:55:09.604225+0000","last_became_peered":"2024-04-16T12:55:09.604225+0000","last_unstale":"2024-04-16T12:55:14.634055+0000","last_undegraded":"2024-04-16T12:55:14.634055+0000","last_fullsized":"2024-04-16T12:55:14.634055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367712+0000","last_change":"2024-04-16T12:55:13.643994+0000","last_active":"2024-04-16T12:55:16.367712+0000","last_peered":"2024-04-16T12:55:16.367712+0000","last_clean":"2024-04-16T12:55:16.367712+0000","last_became_active":"2024-04-16T12:55:13.643551+0000","last_became_peered":"2024-04-16T12:55:13.643551+0000","last_unstale":"2024-04-16T12:55:16.367712+0000","last_undegraded":"2024-04-16T12:55:16.367712+0000","last_fullsized":"2024-04-16T12:55:16.367712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:07.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368044+0000","last_change":"2024-04-16T12:55:09.617118+0000","last_active":"2024-04-16T12:55:16.368044+0000","last_peered":"2024-04-16T12:55:16.368044+0000","last_clean":"2024-04-16T12:55:16.368044+0000","last_became_active":"2024-04-16T12:55:09.616808+0000","last_became_peered":"2024-04-16T12:55:09.616808+0000","last_unstale":"2024-04-16T12:55:16.368044+0000","last_undegraded":"2024-04-16T12:55:16.368044+0000","last_fullsized":"2024-04-16T12:55:16.368044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368824+0000","last_change":"2024-04-16T12:55:08.602196+0000","last_active":"2024-04-16T12:55:16.368824+0000","last_peered":"2024-04-16T12:55:16.368824+0000","last_clean":"2024-04-16T12:55:16.368824+0000","last_became_active":"2024-04-16T12:55:08.601896+0000","last_became_peered":"2024-04-16T12:55:08.601896+0000","last_unstale":"2024-04-16T12:55:16.368824+0000","last_undegraded":"2024-04-16T12:55:16.368824+0000","last_fullsized":"2024-04-16T12:55:16.368824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:44.870969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368907+0000","last_change":"2024-04-16T12:55:13.642915+0000","last_active":"2024-04-16T12:55:16.368907+0000","last_peered":"2024-04-16T12:55:16.368907+0000","last_clean":"2024-04-16T12:55:16.368907+0000","last_became_active":"2024-04-16T12:55:13.642404+0000","last_became_peered":"2024-04-16T12:55:13.642404+0000","last_unstale":"2024-04-16T12:55:16.368907+0000","last_undegraded":"2024-04-16T12:55:16.368907+0000","last_fullsized":"2024-04-16T12:55:16.368907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:12.774418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694920+0000","last_change":"2024-04-16T12:55:09.609312+0000","last_active":"2024-04-16T12:55:14.694920+0000","last_peered":"2024-04-16T12:55:14.694920+0000","last_clean":"2024-04-16T12:55:14.694920+0000","last_became_active":"2024-04-16T12:55:09.608972+0000","last_became_peered":"2024-04-16T12:55:09.608972+0000","last_unstale":"2024-04-16T12:55:14.694920+0000","last_undegraded":"2024-04-16T12:55:14.694920+0000","last_fullsized":"2024-04-16T12:55:14.694920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633101+0000","last_change":"2024-04-16T12:55:08.604374+0000","last_active":"2024-04-16T12:55:14.633101+0000","last_peered":"2024-04-16T12:55:14.633101+0000","last_clean":"2024-04-16T12:55:14.633101+0000","last_became_active":"2024-04-16T12:55:08.603813+0000","last_became_peered":"2024-04-16T12:55:08.603813+0000","last_unstale":"2024-04-16T12:55:14.633101+0000","last_undegraded":"2024-04-16T12:55:14.633101+0000","last_fullsized":"2024-04-16T12:55:14.633101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368459+0000","last_change":"2024-04-16T12:55:13.643708+0000","last_active":"2024-04-16T12:55:16.368459+0000","last_peered":"2024-04-16T12:55:16.368459+0000","last_clean":"2024-04-16T12:55:16.368459+0000","last_became_active":"2024-04-16T12:55:13.643298+0000","last_became_peered":"2024-04-16T12:55:13.643298+0000","last_unstale":"2024-04-16T12:55:16.368459+0000","last_undegraded":"2024-04-16T12:55:16.368459+0000","last_fullsized":"2024-04-16T12:55:16.368459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:46.270789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694839+0000","last_change":"2024-04-16T12:55:09.608016+0000","last_active":"2024-04-16T12:55:14.694839+0000","last_peered":"2024-04-16T12:55:14.694839+0000","last_clean":"2024-04-16T12:55:14.694839+0000","last_became_active":"2024-04-16T12:55:09.607708+0000","last_became_peered":"2024-04-16T12:55:09.607708+0000","last_unstale":"2024-04-16T12:55:14.694839+0000","last_undegraded":"2024-04-16T12:55:14.694839+0000","last_fullsized":"2024-04-16T12:55:14.694839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632908+0000","last_change":"2024-04-16T12:55:08.604999+0000","last_active":"2024-04-16T12:55:14.632908+0000","last_peered":"2024-04-16T12:55:14.632908+0000","last_clean":"2024-04-16T12:55:14.632908+0000","last_became_active":"2024-04-16T12:55:08.603479+0000","last_became_peered":"2024-04-16T12:55:08.603479+0000","last_unstale":"2024-04-16T12:55:14.632908+0000","last_undegraded":"2024-04-16T12:55:14.632908+0000","last_fullsized":"2024-04-16T12:55:14.632908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633683+0000","last_change":"2024-04-16T12:55:13.984277+0000","last_active":"2024-04-16T12:55:14.633683+0000","last_peered":"2024-04-16T12:55:14.633683+0000","last_clean":"2024-04-16T12:55:14.633683+0000","last_became_active":"2024-04-16T12:55:13.983911+0000","last_became_peered":"2024-04-16T12:55:13.983911+0000","last_unstale":"2024-04-16T12:55:14.633683+0000","last_undegraded":"2024-04-16T12:55:14.633683+0000","last_fullsized":"2024-04-16T12:55:14.633683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369689+0000","last_change":"2024-04-16T12:55:09.597064+0000","last_active":"2024-04-16T12:55:16.369689+0000","last_peered":"2024-04-16T12:55:16.369689+0000","last_clean":"2024-04-16T12:55:16.369689+0000","last_became_active":"2024-04-16T12:55:09.596531+0000","last_became_peered":"2024-04-16T12:55:09.596531+0000","last_unstale":"2024-04-16T12:55:16.369689+0000","last_undegraded":"2024-04-16T12:55:16.369689+0000","last_fullsized":"2024-04-16T12:55:16.369689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:41.388856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368817+0000","last_change":"2024-04-16T12:55:08.602603+0000","last_active":"2024-04-16T12:55:16.368817+0000","last_peered":"2024-04-16T12:55:16.368817+0000","last_clean":"2024-04-16T12:55:16.368817+0000","last_became_active":"2024-04-16T12:55:08.602324+0000","last_became_peered":"2024-04-16T12:55:08.602324+0000","last_unstale":"2024-04-16T12:55:16.368817+0000","last_undegraded":"2024-04-16T12:55:16.368817+0000","last_fullsized":"2024-04-16T12:55:16.368817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369344+0000","last_change":"2024-04-16T12:55:13.644854+0000","last_active":"2024-04-16T12:55:16.369344+0000","last_peered":"2024-04-16T12:55:16.369344+0000","last_clean":"2024-04-16T12:55:16.369344+0000","last_became_active":"2024-04-16T12:55:13.644347+0000","last_became_peered":"2024-04-16T12:55:13.644347+0000","last_unstale":"2024-04-16T12:55:16.369344+0000","last_undegraded":"2024-04-16T12:55:16.369344+0000","last_fullsized":"2024-04-16T12:55:16.369344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367451+0000","last_change":"2024-04-16T12:55:09.607401+0000","last_active":"2024-04-16T12:55:16.367451+0000","last_peered":"2024-04-16T12:55:16.367451+0000","last_clean":"2024-04-16T12:55:16.367451+0000","last_became_active":"2024-04-16T12:55:09.607073+0000","last_became_peered":"2024-04-16T12:55:09.607073+0000","last_unstale":"2024-04-16T12:55:16.367451+0000","last_undegraded":"2024-04-16T12:55:16.367451+0000","last_fullsized":"2024-04-16T12:55:16.367451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369471+0000","last_change":"2024-04-16T12:55:08.604773+0000","last_active":"2024-04-16T12:55:16.369471+0000","last_peered":"2024-04-16T12:55:16.369471+0000","last_clean":"2024-04-16T12:55:16.369471+0000","last_became_active":"2024-04-16T12:55:08.604275+0000","last_became_peered":"2024-04-16T12:55:08.604275+0000","last_unstale":"2024-04-16T12:55:16.369471+0000","last_undegraded":"2024-04-16T12:55:16.369471+0000","last_fullsized":"2024-04-16T12:55:16.369471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369565+0000","last_change":"2024-04-16T12:55:13.984733+0000","last_active":"2024-04-16T12:55:16.369565+0000","last_peered":"2024-04-16T12:55:16.369565+0000","last_clean":"2024-04-16T12:55:16.369565+0000","last_became_active":"2024-04-16T12:55:13.983970+0000","last_became_peered":"2024-04-16T12:55:13.983970+0000","last_unstale":"2024-04-16T12:55:16.369565+0000","last_undegraded":"2024-04-16T12:55:16.369565+0000","last_fullsized":"2024-04-16T12:55:16.369565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695546+0000","last_change":"2024-04-16T12:55:09.612698+0000","last_active":"2024-04-16T12:55:14.695546+0000","last_peered":"2024-04-16T12:55:14.695546+0000","last_clean":"2024-04-16T12:55:14.695546+0000","last_became_active":"2024-04-16T12:55:09.612401+0000","last_became_peered":"2024-04-16T12:55:09.612401+0000","last_unstale":"2024-04-16T12:55:14.695546+0000","last_undegraded":"2024-04-16T12:55:14.695546+0000","last_fullsized":"2024-04-16T12:55:14.695546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633691+0000","last_change":"2024-04-16T12:55:08.602265+0000","last_active":"2024-04-16T12:55:14.633691+0000","last_peered":"2024-04-16T12:55:14.633691+0000","last_clean":"2024-04-16T12:55:14.633691+0000","last_became_active":"2024-04-16T12:55:08.601969+0000","last_became_peered":"2024-04-16T12:55:08.601969+0000","last_unstale":"2024-04-16T12:55:14.633691+0000","last_undegraded":"2024-04-16T12:55:14.633691+0000","last_fullsized":"2024-04-16T12:55:14.633691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694594+0000","last_change":"2024-04-16T12:55:13.981871+0000","last_active":"2024-04-16T12:55:14.694594+0000","last_peered":"2024-04-16T12:55:14.694594+0000","last_clean":"2024-04-16T12:55:14.694594+0000","last_became_active":"2024-04-16T12:55:13.981491+0000","last_became_peered":"2024-04-16T12:55:13.981491+0000","last_unstale":"2024-04-16T12:55:14.694594+0000","last_undegraded":"2024-04-16T12:55:14.694594+0000","last_fullsized":"2024-04-16T12:55:14.694594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:58.777887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633569+0000","last_change":"2024-04-16T12:55:09.608036+0000","last_active":"2024-04-16T12:55:14.633569+0000","last_peered":"2024-04-16T12:55:14.633569+0000","last_clean":"2024-04-16T12:55:14.633569+0000","last_became_active":"2024-04-16T12:55:09.607748+0000","last_became_peered":"2024-04-16T12:55:09.607748+0000","last_unstale":"2024-04-16T12:55:14.633569+0000","last_undegraded":"2024-04-16T12:55:14.633569+0000","last_fullsized":"2024-04-16T12:55:14.633569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368966+0000","last_change":"2024-04-16T12:55:08.606601+0000","last_active":"2024-04-16T12:55:16.368966+0000","last_peered":"2024-04-16T12:55:16.368966+0000","last_clean":"2024-04-16T12:55:16.368966+0000","last_became_active":"2024-04-16T12:55:08.606293+0000","last_became_peered":"2024-04-16T12:55:08.606293+0000","last_unstale":"2024-04-16T12:55:16.368966+0000","last_undegraded":"2024-04-16T12:55:16.368966+0000","last_fullsized":"2024-04-16T12:55:16.368966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:02.120498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367098+0000","last_change":"2024-04-16T12:55:13.981993+0000","last_active":"2024-04-16T12:55:16.367098+0000","last_peered":"2024-04-16T12:55:16.367098+0000","last_clean":"2024-04-16T12:55:16.367098+0000","last_became_active":"2024-04-16T12:55:13.981384+0000","last_became_peered":"2024-04-16T12:55:13.981384+0000","last_unstale":"2024-04-16T12:55:16.367098+0000","last_undegraded":"2024-04-16T12:55:16.367098+0000","last_fullsized":"2024-04-16T12:55:16.367098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634120+0000","last_change":"2024-04-16T12:55:09.616638+0000","last_active":"2024-04-16T12:55:14.634120+0000","last_peered":"2024-04-16T12:55:14.634120+0000","last_clean":"2024-04-16T12:55:14.634120+0000","last_became_active":"2024-04-16T12:55:09.616217+0000","last_became_peered":"2024-04-16T12:55:09.616217+0000","last_unstale":"2024-04-16T12:55:14.634120+0000","last_undegraded":"2024-04-16T12:55:14.634120+0000","last_fullsized":"2024-04-16T12:55:14.634120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633590+0000","last_change":"2024-04-16T12:55:08.598000+0000","last_active":"2024-04-16T12:55:14.633590+0000","last_peered":"2024-04-16T12:55:14.633590+0000","last_clean":"2024-04-16T12:55:14.633590+0000","last_became_active":"2024-04-16T12:55:08.597703+0000","last_became_peered":"2024-04-16T12:55:08.597703+0000","last_unstale":"2024-04-16T12:55:14.633590+0000","last_undegraded":"2024-04-16T12:55:14.633590+0000","last_fullsized":"2024-04-16T12:55:14.633590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632782+0000","last_change":"2024-04-16T12:55:13.646625+0000","last_active":"2024-04-16T12:55:14.632782+0000","last_peered":"2024-04-16T12:55:14.632782+0000","last_clean":"2024-04-16T12:55:14.632782+0000","last_became_active":"2024-04-16T12:55:13.646260+0000","last_became_peered":"2024-04-16T12:55:13.646260+0000","last_unstale":"2024-04-16T12:55:14.632782+0000","last_undegraded":"2024-04-16T12:55:14.632782+0000","last_fullsized":"2024-04-16T12:55:14.632782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369676+0000","last_change":"2024-04-16T12:55:09.600934+0000","last_active":"2024-04-16T12:55:16.369676+0000","last_peered":"2024-04-16T12:55:16.369676+0000","last_clean":"2024-04-16T12:55:16.369676+0000","last_became_active":"2024-04-16T12:55:09.600399+0000","last_became_peered":"2024-04-16T12:55:09.600399+0000","last_unstale":"2024-04-16T12:55:16.369676+0000","last_undegraded":"2024-04-16T12:55:16.369676+0000","last_fullsized":"2024-04-16T12:55:16.369676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:43.700295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633893+0000","last_change":"2024-04-16T12:55:08.604212+0000","last_active":"2024-04-16T12:55:14.633893+0000","last_peered":"2024-04-16T12:55:14.633893+0000","last_clean":"2024-04-16T12:55:14.633893+0000","last_became_active":"2024-04-16T12:55:08.603941+0000","last_became_peered":"2024-04-16T12:55:08.603941+0000","last_unstale":"2024-04-16T12:55:14.633893+0000","last_undegraded":"2024-04-16T12:55:14.633893+0000","last_fullsized":"2024-04-16T12:55:14.633893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633482+0000","last_change":"2024-04-16T12:55:13.648783+0000","last_active":"2024-04-16T12:55:14.633482+0000","last_peered":"2024-04-16T12:55:14.633482+0000","last_clean":"2024-04-16T12:55:14.633482+0000","last_became_active":"2024-04-16T12:55:13.648394+0000","last_became_peered":"2024-04-16T12:55:13.648394+0000","last_unstale":"2024-04-16T12:55:14.633482+0000","last_undegraded":"2024-04-16T12:55:14.633482+0000","last_fullsized":"2024-04-16T12:55:14.633482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633151+0000","last_change":"2024-04-16T12:55:09.610829+0000","last_active":"2024-04-16T12:55:14.633151+0000","last_peered":"2024-04-16T12:55:14.633151+0000","last_clean":"2024-04-16T12:55:14.633151+0000","last_became_active":"2024-04-16T12:55:09.607200+0000","last_became_peered":"2024-04-16T12:55:09.607200+0000","last_unstale":"2024-04-16T12:55:14.633151+0000","last_undegraded":"2024-04-16T12:55:14.633151+0000","last_fullsized":"2024-04-16T12:55:14.633151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631656+0000","last_change":"2024-04-16T12:55:08.604218+0000","last_active":"2024-04-16T12:55:14.631656+0000","last_peered":"2024-04-16T12:55:14.631656+0000","last_clean":"2024-04-16T12:55:14.631656+0000","last_became_active":"2024-04-16T12:55:08.603910+0000","last_became_peered":"2024-04-16T12:55:08.603910+0000","last_unstale":"2024-04-16T12:55:14.631656+0000","last_undegraded":"2024-04-16T12:55:14.631656+0000","last_fullsized":"2024-04-16T12:55:14.631656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633704+0000","last_change":"2024-04-16T12:55:13.647025+0000","last_active":"2024-04-16T12:55:14.633704+0000","last_peered":"2024-04-16T12:55:14.633704+0000","last_clean":"2024-04-16T12:55:14.633704+0000","last_became_active":"2024-04-16T12:55:13.646214+0000","last_became_peered":"2024-04-16T12:55:13.646214+0000","last_unstale":"2024-04-16T12:55:14.633704+0000","last_undegraded":"2024-04-16T12:55:14.633704+0000","last_fullsized":"2024-04-16T12:55:14.633704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.366914+0000","last_change":"2024-04-16T12:55:09.600161+0000","last_active":"2024-04-16T12:55:16.366914+0000","last_peered":"2024-04-16T12:55:16.366914+0000","last_clean":"2024-04-16T12:55:16.366914+0000","last_became_active":"2024-04-16T12:55:09.599040+0000","last_became_peered":"2024-04-16T12:55:09.599040+0000","last_unstale":"2024-04-16T12:55:16.366914+0000","last_undegraded":"2024-04-16T12:55:16.366914+0000","last_fullsized":"2024-04-16T12:55:16.366914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:03.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369035+0000","last_change":"2024-04-16T12:55:08.602446+0000","last_active":"2024-04-16T12:55:16.369035+0000","last_peered":"2024-04-16T12:55:16.369035+0000","last_clean":"2024-04-16T12:55:16.369035+0000","last_became_active":"2024-04-16T12:55:08.602174+0000","last_became_peered":"2024-04-16T12:55:08.602174+0000","last_unstale":"2024-04-16T12:55:16.369035+0000","last_undegraded":"2024-04-16T12:55:16.369035+0000","last_fullsized":"2024-04-16T12:55:16.369035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367361+0000","last_change":"2024-04-16T12:55:13.981927+0000","last_active":"2024-04-16T12:55:16.367361+0000","last_peered":"2024-04-16T12:55:16.367361+0000","last_clean":"2024-04-16T12:55:16.367361+0000","last_became_active":"2024-04-16T12:55:13.981550+0000","last_became_peered":"2024-04-16T12:55:13.981550+0000","last_unstale":"2024-04-16T12:55:16.367361+0000","last_undegraded":"2024-04-16T12:55:16.367361+0000","last_fullsized":"2024-04-16T12:55:16.367361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:30.099478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694649+0000","last_change":"2024-04-16T12:55:09.615938+0000","last_active":"2024-04-16T12:55:14.694649+0000","last_peered":"2024-04-16T12:55:14.694649+0000","last_clean":"2024-04-16T12:55:14.694649+0000","last_became_active":"2024-04-16T12:55:09.615177+0000","last_became_peered":"2024-04-16T12:55:09.615177+0000","last_unstale":"2024-04-16T12:55:14.694649+0000","last_undegraded":"2024-04-16T12:55:14.694649+0000","last_fullsized":"2024-04-16T12:55:14.694649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633571+0000","last_change":"2024-04-16T12:55:08.599197+0000","last_active":"2024-04-16T12:55:14.633571+0000","last_peered":"2024-04-16T12:55:14.633571+0000","last_clean":"2024-04-16T12:55:14.633571+0000","last_became_active":"2024-04-16T12:55:08.598892+0000","last_became_peered":"2024-04-16T12:55:08.598892+0000","last_unstale":"2024-04-16T12:55:14.633571+0000","last_undegraded":"2024-04-16T12:55:14.633571+0000","last_fullsized":"2024-04-16T12:55:14.633571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368934+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:55:16.368934+0000","last_peered":"2024-04-16T12:55:16.368934+0000","last_clean":"2024-04-16T12:55:16.368934+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:55:16.368934+0000","last_undegraded":"2024-04-16T12:55:16.368934+0000","last_fullsized":"2024-04-16T12:55:16.368934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368883+0000","last_change":"2024-04-16T12:55:13.983109+0000","last_active":"2024-04-16T12:55:16.368883+0000","last_peered":"2024-04-16T12:55:16.368883+0000","last_clean":"2024-04-16T12:55:16.368883+0000","last_became_active":"2024-04-16T12:55:13.982685+0000","last_became_peered":"2024-04-16T12:55:13.982685+0000","last_unstale":"2024-04-16T12:55:16.368883+0000","last_undegraded":"2024-04-16T12:55:16.368883+0000","last_fullsized":"2024-04-16T12:55:16.368883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368489+0000","last_change":"2024-04-16T12:55:09.615455+0000","last_active":"2024-04-16T12:55:16.368489+0000","last_peered":"2024-04-16T12:55:16.368489+0000","last_clean":"2024-04-16T12:55:16.368489+0000","last_became_active":"2024-04-16T12:55:09.614879+0000","last_became_peered":"2024-04-16T12:55:09.614879+0000","last_unstale":"2024-04-16T12:55:16.368489+0000","last_undegraded":"2024-04-16T12:55:16.368489+0000","last_fullsized":"2024-04-16T12:55:16.368489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631857+0000","last_change":"2024-04-16T12:55:08.602417+0000","last_active":"2024-04-16T12:55:14.631857+0000","last_peered":"2024-04-16T12:55:14.631857+0000","last_clean":"2024-04-16T12:55:14.631857+0000","last_became_active":"2024-04-16T12:55:08.602116+0000","last_became_peered":"2024-04-16T12:55:08.602116+0000","last_unstale":"2024-04-16T12:55:14.631857+0000","last_undegraded":"2024-04-16T12:55:14.631857+0000","last_fullsized":"2024-04-16T12:55:14.631857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367931+0000","last_change":"2024-04-16T12:55:13.982825+0000","last_active":"2024-04-16T12:55:16.367931+0000","last_peered":"2024-04-16T12:55:16.367931+0000","last_clean":"2024-04-16T12:55:16.367931+0000","last_became_active":"2024-04-16T12:55:13.981463+0000","last_became_peered":"2024-04-16T12:55:13.981463+0000","last_unstale":"2024-04-16T12:55:16.367931+0000","last_undegraded":"2024-04-16T12:55:16.367931+0000","last_fullsized":"2024-04-16T12:55:16.367931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633956+0000","last_change":"2024-04-16T12:55:09.615888+0000","last_active":"2024-04-16T12:55:14.633956+0000","last_peered":"2024-04-16T12:55:14.633956+0000","last_clean":"2024-04-16T12:55:14.633956+0000","last_became_active":"2024-04-16T12:55:09.615272+0000","last_became_peered":"2024-04-16T12:55:09.615272+0000","last_unstale":"2024-04-16T12:55:14.633956+0000","last_undegraded":"2024-04-16T12:55:14.633956+0000","last_fullsized":"2024-04-16T12:55:14.633956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633411+0000","last_change":"2024-04-16T12:55:08.601281+0000","last_active":"2024-04-16T12:55:14.633411+0000","last_peered":"2024-04-16T12:55:14.633411+0000","last_clean":"2024-04-16T12:55:14.633411+0000","last_became_active":"2024-04-16T12:55:08.600899+0000","last_became_peered":"2024-04-16T12:55:08.600899+0000","last_unstale":"2024-04-16T12:55:14.633411+0000","last_undegraded":"2024-04-16T12:55:14.633411+0000","last_fullsized":"2024-04-16T12:55:14.633411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367245+0000","last_change":"2024-04-16T12:55:13.647207+0000","last_active":"2024-04-16T12:55:16.367245+0000","last_peered":"2024-04-16T12:55:16.367245+0000","last_clean":"2024-04-16T12:55:16.367245+0000","last_became_active":"2024-04-16T12:55:13.646389+0000","last_became_peered":"2024-04-16T12:55:13.646389+0000","last_unstale":"2024-04-16T12:55:16.367245+0000","last_undegraded":"2024-04-16T12:55:16.367245+0000","last_fullsized":"2024-04-16T12:55:16.367245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368504+0000","last_change":"2024-04-16T12:55:09.617673+0000","last_active":"2024-04-16T12:55:16.368504+0000","last_peered":"2024-04-16T12:55:16.368504+0000","last_clean":"2024-04-16T12:55:16.368504+0000","last_became_active":"2024-04-16T12:55:09.617168+0000","last_became_peered":"2024-04-16T12:55:09.617168+0000","last_unstale":"2024-04-16T12:55:16.368504+0000","last_undegraded":"2024-04-16T12:55:16.368504+0000","last_fullsized":"2024-04-16T12:55:16.368504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:18.474748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632028+0000","last_change":"2024-04-16T12:55:08.603386+0000","last_active":"2024-04-16T12:55:14.632028+0000","last_peered":"2024-04-16T12:55:14.632028+0000","last_clean":"2024-04-16T12:55:14.632028+0000","last_became_active":"2024-04-16T12:55:08.603101+0000","last_became_peered":"2024-04-16T12:55:08.603101+0000","last_unstale":"2024-04-16T12:55:14.632028+0000","last_undegraded":"2024-04-16T12:55:14.632028+0000","last_fullsized":"2024-04-16T12:55:14.632028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633245+0000","last_change":"2024-04-16T12:55:13.982430+0000","last_active":"2024-04-16T12:55:14.633245+0000","last_peered":"2024-04-16T12:55:14.633245+0000","last_clean":"2024-04-16T12:55:14.633245+0000","last_became_active":"2024-04-16T12:55:13.982015+0000","last_became_peered":"2024-04-16T12:55:13.982015+0000","last_unstale":"2024-04-16T12:55:14.633245+0000","last_undegraded":"2024-04-16T12:55:14.633245+0000","last_fullsized":"2024-04-16T12:55:14.633245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368249+0000","last_change":"2024-04-16T12:55:09.616105+0000","last_active":"2024-04-16T12:55:16.368249+0000","last_peered":"2024-04-16T12:55:16.368249+0000","last_clean":"2024-04-16T12:55:16.368249+0000","last_became_active":"2024-04-16T12:55:09.615832+0000","last_became_peered":"2024-04-16T12:55:09.615832+0000","last_unstale":"2024-04-16T12:55:16.368249+0000","last_undegraded":"2024-04-16T12:55:16.368249+0000","last_fullsized":"2024-04-16T12:55:16.368249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368416+0000","last_change":"2024-04-16T12:55:08.603695+0000","last_active":"2024-04-16T12:55:16.368416+0000","last_peered":"2024-04-16T12:55:16.368416+0000","last_clean":"2024-04-16T12:55:16.368416+0000","last_became_active":"2024-04-16T12:55:08.603425+0000","last_became_peered":"2024-04-16T12:55:08.603425+0000","last_unstale":"2024-04-16T12:55:16.368416+0000","last_undegraded":"2024-04-16T12:55:16.368416+0000","last_fullsized":"2024-04-16T12:55:16.368416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369160+0000","last_change":"2024-04-16T12:55:13.644589+0000","last_active":"2024-04-16T12:55:16.369160+0000","last_peered":"2024-04-16T12:55:16.369160+0000","last_clean":"2024-04-16T12:55:16.369160+0000","last_became_active":"2024-04-16T12:55:13.644211+0000","last_became_peered":"2024-04-16T12:55:13.644211+0000","last_unstale":"2024-04-16T12:55:16.369160+0000","last_undegraded":"2024-04-16T12:55:16.369160+0000","last_fullsized":"2024-04-16T12:55:16.369160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:38.226650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368542+0000","last_change":"2024-04-16T12:55:09.615275+0000","last_active":"2024-04-16T12:55:16.368542+0000","last_peered":"2024-04-16T12:55:16.368542+0000","last_clean":"2024-04-16T12:55:16.368542+0000","last_became_active":"2024-04-16T12:55:09.614772+0000","last_became_peered":"2024-04-16T12:55:09.614772+0000","last_unstale":"2024-04-16T12:55:16.368542+0000","last_undegraded":"2024-04-16T12:55:16.368542+0000","last_fullsized":"2024-04-16T12:55:16.368542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631386+0000","last_change":"2024-04-16T12:55:08.598164+0000","last_active":"2024-04-16T12:55:14.631386+0000","last_peered":"2024-04-16T12:55:14.631386+0000","last_clean":"2024-04-16T12:55:14.631386+0000","last_became_active":"2024-04-16T12:55:08.597846+0000","last_became_peered":"2024-04-16T12:55:08.597846+0000","last_unstale":"2024-04-16T12:55:14.631386+0000","last_undegraded":"2024-04-16T12:55:14.631386+0000","last_fullsized":"2024-04-16T12:55:14.631386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367265+0000","last_change":"2024-04-16T12:55:13.640511+0000","last_active":"2024-04-16T12:55:16.367265+0000","last_peered":"2024-04-16T12:55:16.367265+0000","last_clean":"2024-04-16T12:55:16.367265+0000","last_became_active":"2024-04-16T12:55:13.639882+0000","last_became_peered":"2024-04-16T12:55:13.639882+0000","last_unstale":"2024-04-16T12:55:16.367265+0000","last_undegraded":"2024-04-16T12:55:16.367265+0000","last_fullsized":"2024-04-16T12:55:16.367265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367597+0000","last_change":"2024-04-16T12:55:09.609001+0000","last_active":"2024-04-16T12:55:16.367597+0000","last_peered":"2024-04-16T12:55:16.367597+0000","last_clean":"2024-04-16T12:55:16.367597+0000","last_became_active":"2024-04-16T12:55:09.608734+0000","last_became_peered":"2024-04-16T12:55:09.608734+0000","last_unstale":"2024-04-16T12:55:16.367597+0000","last_undegraded":"2024-04-16T12:55:16.367597+0000","last_fullsized":"2024-04-16T12:55:16.367597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367952+0000","last_change":"2024-04-16T12:55:08.603335+0000","last_active":"2024-04-16T12:55:16.367952+0000","last_peered":"2024-04-16T12:55:16.367952+0000","last_clean":"2024-04-16T12:55:16.367952+0000","last_became_active":"2024-04-16T12:55:08.602990+0000","last_became_peered":"2024-04-16T12:55:08.602990+0000","last_unstale":"2024-04-16T12:55:16.367952+0000","last_undegraded":"2024-04-16T12:55:16.367952+0000","last_fullsized":"2024-04-16T12:55:16.367952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695518+0000","last_change":"2024-04-16T12:55:13.982306+0000","last_active":"2024-04-16T12:55:14.695518+0000","last_peered":"2024-04-16T12:55:14.695518+0000","last_clean":"2024-04-16T12:55:14.695518+0000","last_became_active":"2024-04-16T12:55:13.981930+0000","last_became_peered":"2024-04-16T12:55:13.981930+0000","last_unstale":"2024-04-16T12:55:14.695518+0000","last_undegraded":"2024-04-16T12:55:14.695518+0000","last_fullsized":"2024-04-16T12:55:14.695518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:08.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368720+0000","last_change":"2024-04-16T12:55:09.614600+0000","last_active":"2024-04-16T12:55:16.368720+0000","last_peered":"2024-04-16T12:55:16.368720+0000","last_clean":"2024-04-16T12:55:16.368720+0000","last_became_active":"2024-04-16T12:55:09.614325+0000","last_became_peered":"2024-04-16T12:55:09.614325+0000","last_unstale":"2024-04-16T12:55:16.368720+0000","last_undegraded":"2024-04-16T12:55:16.368720+0000","last_fullsized":"2024-04-16T12:55:16.368720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633785+0000","last_change":"2024-04-16T12:55:08.608010+0000","last_active":"2024-04-16T12:55:14.633785+0000","last_peered":"2024-04-16T12:55:14.633785+0000","last_clean":"2024-04-16T12:55:14.633785+0000","last_became_active":"2024-04-16T12:55:08.607694+0000","last_became_peered":"2024-04-16T12:55:08.607694+0000","last_unstale":"2024-04-16T12:55:14.633785+0000","last_undegraded":"2024-04-16T12:55:14.633785+0000","last_fullsized":"2024-04-16T12:55:14.633785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695213+0000","last_change":"2024-04-16T12:55:13.981780+0000","last_active":"2024-04-16T12:55:14.695213+0000","last_peered":"2024-04-16T12:55:14.695213+0000","last_clean":"2024-04-16T12:55:14.695213+0000","last_became_active":"2024-04-16T12:55:13.981378+0000","last_became_peered":"2024-04-16T12:55:13.981378+0000","last_unstale":"2024-04-16T12:55:14.695213+0000","last_undegraded":"2024-04-16T12:55:14.695213+0000","last_fullsized":"2024-04-16T12:55:14.695213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:34.588593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367107+0000","last_change":"2024-04-16T12:55:09.611318+0000","last_active":"2024-04-16T12:55:16.367107+0000","last_peered":"2024-04-16T12:55:16.367107+0000","last_clean":"2024-04-16T12:55:16.367107+0000","last_became_active":"2024-04-16T12:55:09.611021+0000","last_became_peered":"2024-04-16T12:55:09.611021+0000","last_unstale":"2024-04-16T12:55:16.367107+0000","last_undegraded":"2024-04-16T12:55:16.367107+0000","last_fullsized":"2024-04-16T12:55:16.367107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:22.528974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367349+0000","last_change":"2024-04-16T12:55:08.601634+0000","last_active":"2024-04-16T12:55:16.367349+0000","last_peered":"2024-04-16T12:55:16.367349+0000","last_clean":"2024-04-16T12:55:16.367349+0000","last_became_active":"2024-04-16T12:55:08.601348+0000","last_became_peered":"2024-04-16T12:55:08.601348+0000","last_unstale":"2024-04-16T12:55:16.367349+0000","last_undegraded":"2024-04-16T12:55:16.367349+0000","last_fullsized":"2024-04-16T12:55:16.367349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:39.045294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634061+0000","last_change":"2024-04-16T12:55:13.982101+0000","last_active":"2024-04-16T12:55:14.634061+0000","last_peered":"2024-04-16T12:55:14.634061+0000","last_clean":"2024-04-16T12:55:14.634061+0000","last_became_active":"2024-04-16T12:55:13.981652+0000","last_became_peered":"2024-04-16T12:55:13.981652+0000","last_unstale":"2024-04-16T12:55:14.634061+0000","last_undegraded":"2024-04-16T12:55:14.634061+0000","last_fullsized":"2024-04-16T12:55:14.634061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368372+0000","last_change":"2024-04-16T12:55:09.620820+0000","last_active":"2024-04-16T12:55:16.368372+0000","last_peered":"2024-04-16T12:55:16.368372+0000","last_clean":"2024-04-16T12:55:16.368372+0000","last_became_active":"2024-04-16T12:55:09.620534+0000","last_became_peered":"2024-04-16T12:55:09.620534+0000","last_unstale":"2024-04-16T12:55:16.368372+0000","last_undegraded":"2024-04-16T12:55:16.368372+0000","last_fullsized":"2024-04-16T12:55:16.368372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:19.234376+0000","last_change":"2024-04-16T12:55:08.605338+0000","last_active":"2024-04-16T12:55:19.234376+0000","last_peered":"2024-04-16T12:55:19.234376+0000","last_clean":"2024-04-16T12:55:19.234376+0000","last_became_active":"2024-04-16T12:55:08.604774+0000","last_became_peered":"2024-04-16T12:55:08.604774+0000","last_unstale":"2024-04-16T12:55:19.234376+0000","last_undegraded":"2024-04-16T12:55:19.234376+0000","last_fullsized":"2024-04-16T12:55:19.234376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633006+0000","last_change":"2024-04-16T12:55:13.646516+0000","last_active":"2024-04-16T12:55:14.633006+0000","last_peered":"2024-04-16T12:55:14.633006+0000","last_clean":"2024-04-16T12:55:14.633006+0000","last_became_active":"2024-04-16T12:55:13.645703+0000","last_became_peered":"2024-04-16T12:55:13.645703+0000","last_unstale":"2024-04-16T12:55:14.633006+0000","last_undegraded":"2024-04-16T12:55:14.633006+0000","last_fullsized":"2024-04-16T12:55:14.633006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369060+0000","last_change":"2024-04-16T12:55:09.606507+0000","last_active":"2024-04-16T12:55:16.369060+0000","last_peered":"2024-04-16T12:55:16.369060+0000","last_clean":"2024-04-16T12:55:16.369060+0000","last_became_active":"2024-04-16T12:55:09.606250+0000","last_became_peered":"2024-04-16T12:55:09.606250+0000","last_unstale":"2024-04-16T12:55:16.369060+0000","last_undegraded":"2024-04-16T12:55:16.369060+0000","last_fullsized":"2024-04-16T12:55:16.369060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633241+0000","last_change":"2024-04-16T12:55:08.609448+0000","last_active":"2024-04-16T12:55:14.633241+0000","last_peered":"2024-04-16T12:55:14.633241+0000","last_clean":"2024-04-16T12:55:14.633241+0000","last_became_active":"2024-04-16T12:55:08.609122+0000","last_became_peered":"2024-04-16T12:55:08.609122+0000","last_unstale":"2024-04-16T12:55:14.633241+0000","last_undegraded":"2024-04-16T12:55:14.633241+0000","last_fullsized":"2024-04-16T12:55:14.633241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369406+0000","last_change":"2024-04-16T12:55:13.644519+0000","last_active":"2024-04-16T12:55:16.369406+0000","last_peered":"2024-04-16T12:55:16.369406+0000","last_clean":"2024-04-16T12:55:16.369406+0000","last_became_active":"2024-04-16T12:55:13.644072+0000","last_became_peered":"2024-04-16T12:55:13.644072+0000","last_unstale":"2024-04-16T12:55:16.369406+0000","last_undegraded":"2024-04-16T12:55:16.369406+0000","last_fullsized":"2024-04-16T12:55:16.369406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367454+0000","last_change":"2024-04-16T12:55:09.599598+0000","last_active":"2024-04-16T12:55:16.367454+0000","last_peered":"2024-04-16T12:55:16.367454+0000","last_clean":"2024-04-16T12:55:16.367454+0000","last_became_active":"2024-04-16T12:55:09.599115+0000","last_became_peered":"2024-04-16T12:55:09.599115+0000","last_unstale":"2024-04-16T12:55:16.367454+0000","last_undegraded":"2024-04-16T12:55:16.367454+0000","last_fullsized":"2024-04-16T12:55:16.367454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633947+0000","last_change":"2024-04-16T12:55:08.607221+0000","last_active":"2024-04-16T12:55:14.633947+0000","last_peered":"2024-04-16T12:55:14.633947+0000","last_clean":"2024-04-16T12:55:14.633947+0000","last_became_active":"2024-04-16T12:55:08.606654+0000","last_became_peered":"2024-04-16T12:55:08.606654+0000","last_unstale":"2024-04-16T12:55:14.633947+0000","last_undegraded":"2024-04-16T12:55:14.633947+0000","last_fullsized":"2024-04-16T12:55:14.633947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694767+0000","last_change":"2024-04-16T12:55:13.638453+0000","last_active":"2024-04-16T12:55:14.694767+0000","last_peered":"2024-04-16T12:55:14.694767+0000","last_clean":"2024-04-16T12:55:14.694767+0000","last_became_active":"2024-04-16T12:55:13.637979+0000","last_became_peered":"2024-04-16T12:55:13.637979+0000","last_unstale":"2024-04-16T12:55:14.694767+0000","last_undegraded":"2024-04-16T12:55:14.694767+0000","last_fullsized":"2024-04-16T12:55:14.694767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:03:31.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633869+0000","last_change":"2024-04-16T12:55:09.608895+0000","last_active":"2024-04-16T12:55:14.633869+0000","last_peered":"2024-04-16T12:55:14.633869+0000","last_clean":"2024-04-16T12:55:14.633869+0000","last_became_active":"2024-04-16T12:55:09.608614+0000","last_became_peered":"2024-04-16T12:55:09.608614+0000","last_unstale":"2024-04-16T12:55:14.633869+0000","last_undegraded":"2024-04-16T12:55:14.633869+0000","last_fullsized":"2024-04-16T12:55:14.633869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369378+0000","last_change":"2024-04-16T12:55:08.609382+0000","last_active":"2024-04-16T12:55:16.369378+0000","last_peered":"2024-04-16T12:55:16.369378+0000","last_clean":"2024-04-16T12:55:16.369378+0000","last_became_active":"2024-04-16T12:55:08.609119+0000","last_became_peered":"2024-04-16T12:55:08.609119+0000","last_unstale":"2024-04-16T12:55:16.369378+0000","last_undegraded":"2024-04-16T12:55:16.369378+0000","last_fullsized":"2024-04-16T12:55:16.369378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694727+0000","last_change":"2024-04-16T12:55:13.983697+0000","last_active":"2024-04-16T12:55:14.694727+0000","last_peered":"2024-04-16T12:55:14.694727+0000","last_clean":"2024-04-16T12:55:14.694727+0000","last_became_active":"2024-04-16T12:55:13.983341+0000","last_became_peered":"2024-04-16T12:55:13.983341+0000","last_unstale":"2024-04-16T12:55:14.694727+0000","last_undegraded":"2024-04-16T12:55:14.694727+0000","last_fullsized":"2024-04-16T12:55:14.694727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367175+0000","last_change":"2024-04-16T12:55:13.982783+0000","last_active":"2024-04-16T12:55:16.367175+0000","last_peered":"2024-04-16T12:55:16.367175+0000","last_clean":"2024-04-16T12:55:16.367175+0000","last_became_active":"2024-04-16T12:55:13.982410+0000","last_became_peered":"2024-04-16T12:55:13.982410+0000","last_unstale":"2024-04-16T12:55:16.367175+0000","last_undegraded":"2024-04-16T12:55:16.367175+0000","last_fullsized":"2024-04-16T12:55:16.367175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632676+0000","last_change":"2024-04-16T12:55:09.613731+0000","last_active":"2024-04-16T12:55:14.632676+0000","last_peered":"2024-04-16T12:55:14.632676+0000","last_clean":"2024-04-16T12:55:14.632676+0000","last_became_active":"2024-04-16T12:55:09.613019+0000","last_became_peered":"2024-04-16T12:55:09.613019+0000","last_unstale":"2024-04-16T12:55:14.632676+0000","last_undegraded":"2024-04-16T12:55:14.632676+0000","last_fullsized":"2024-04-16T12:55:14.632676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633344+0000","last_change":"2024-04-16T12:55:08.607825+0000","last_active":"2024-04-16T12:55:14.633344+0000","last_peered":"2024-04-16T12:55:14.633344+0000","last_clean":"2024-04-16T12:55:14.633344+0000","last_became_active":"2024-04-16T12:55:08.607513+0000","last_became_peered":"2024-04-16T12:55:08.607513+0000","last_unstale":"2024-04-16T12:55:14.633344+0000","last_undegraded":"2024-04-16T12:55:14.633344+0000","last_fullsized":"2024-04-16T12:55:14.633344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369166+0000","last_change":"2024-04-16T12:55:13.648936+0000","last_active":"2024-04-16T12:55:16.369166+0000","last_peered":"2024-04-16T12:55:16.369166+0000","last_clean":"2024-04-16T12:55:16.369166+0000","last_became_active":"2024-04-16T12:55:13.648492+0000","last_became_peered":"2024-04-16T12:55:13.648492+0000","last_unstale":"2024-04-16T12:55:16.369166+0000","last_undegraded":"2024-04-16T12:55:16.369166+0000","last_fullsized":"2024-04-16T12:55:16.369166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694761+0000","last_change":"2024-04-16T12:55:09.613188+0000","last_active":"2024-04-16T12:55:14.694761+0000","last_peered":"2024-04-16T12:55:14.694761+0000","last_clean":"2024-04-16T12:55:14.694761+0000","last_became_active":"2024-04-16T12:55:09.612860+0000","last_became_peered":"2024-04-16T12:55:09.612860+0000","last_unstale":"2024-04-16T12:55:14.694761+0000","last_undegraded":"2024-04-16T12:55:14.694761+0000","last_fullsized":"2024-04-16T12:55:14.694761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694941+0000","last_change":"2024-04-16T12:55:08.603901+0000","last_active":"2024-04-16T12:55:14.694941+0000","last_peered":"2024-04-16T12:55:14.694941+0000","last_clean":"2024-04-16T12:55:14.694941+0000","last_became_active":"2024-04-16T12:55:08.603600+0000","last_became_peered":"2024-04-16T12:55:08.603600+0000","last_unstale":"2024-04-16T12:55:14.694941+0000","last_undegraded":"2024-04-16T12:55:14.694941+0000","last_fullsized":"2024-04-16T12:55:14.694941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368157+0000","last_change":"2024-04-16T12:55:08.603403+0000","last_active":"2024-04-16T12:55:16.368157+0000","last_peered":"2024-04-16T12:55:16.368157+0000","last_clean":"2024-04-16T12:55:16.368157+0000","last_became_active":"2024-04-16T12:55:08.603126+0000","last_became_peered":"2024-04-16T12:55:08.603126+0000","last_unstale":"2024-04-16T12:55:16.368157+0000","last_undegraded":"2024-04-16T12:55:16.368157+0000","last_fullsized":"2024-04-16T12:55:16.368157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367337+0000","last_change":"2024-04-16T12:55:09.599833+0000","last_active":"2024-04-16T12:55:16.367337+0000","last_peered":"2024-04-16T12:55:16.367337+0000","last_clean":"2024-04-16T12:55:16.367337+0000","last_became_active":"2024-04-16T12:55:09.599149+0000","last_became_peered":"2024-04-16T12:55:09.599149+0000","last_unstale":"2024-04-16T12:55:16.367337+0000","last_undegraded":"2024-04-16T12:55:16.367337+0000","last_fullsized":"2024-04-16T12:55:16.367337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631664+0000","last_change":"2024-04-16T12:55:13.650199+0000","last_active":"2024-04-16T12:55:14.631664+0000","last_peered":"2024-04-16T12:55:14.631664+0000","last_clean":"2024-04-16T12:55:14.631664+0000","last_became_active":"2024-04-16T12:55:13.649637+0000","last_became_peered":"2024-04-16T12:55:13.649637+0000","last_unstale":"2024-04-16T12:55:14.631664+0000","last_undegraded":"2024-04-16T12:55:14.631664+0000","last_fullsized":"2024-04-16T12:55:14.631664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:31.305753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694949+0000","last_change":"2024-04-16T12:55:08.606921+0000","last_active":"2024-04-16T12:55:14.694949+0000","last_peered":"2024-04-16T12:55:14.694949+0000","last_clean":"2024-04-16T12:55:14.694949+0000","last_became_active":"2024-04-16T12:55:08.606543+0000","last_became_peered":"2024-04-16T12:55:08.606543+0000","last_unstale":"2024-04-16T12:55:14.694949+0000","last_undegraded":"2024-04-16T12:55:14.694949+0000","last_fullsized":"2024-04-16T12:55:14.694949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367882+0000","last_change":"2024-04-16T12:55:09.607307+0000","last_active":"2024-04-16T12:55:16.367882+0000","last_peered":"2024-04-16T12:55:16.367882+0000","last_clean":"2024-04-16T12:55:16.367882+0000","last_became_active":"2024-04-16T12:55:09.607019+0000","last_became_peered":"2024-04-16T12:55:09.607019+0000","last_unstale":"2024-04-16T12:55:16.367882+0000","last_undegraded":"2024-04-16T12:55:16.367882+0000","last_fullsized":"2024-04-16T12:55:16.367882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:02.600497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695264+0000","last_change":"2024-04-16T12:55:13.641212+0000","last_active":"2024-04-16T12:55:14.695264+0000","last_peered":"2024-04-16T12:55:14.695264+0000","last_clean":"2024-04-16T12:55:14.695264+0000","last_became_active":"2024-04-16T12:55:13.640805+0000","last_became_peered":"2024-04-16T12:55:13.640805+0000","last_unstale":"2024-04-16T12:55:14.695264+0000","last_undegraded":"2024-04-16T12:55:14.695264+0000","last_fullsized":"2024-04-16T12:55:14.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:17.726629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367396+0000","last_change":"2024-04-16T12:55:09.609579+0000","last_active":"2024-04-16T12:55:16.367396+0000","last_peered":"2024-04-16T12:55:16.367396+0000","last_clean":"2024-04-16T12:55:16.367396+0000","last_became_active":"2024-04-16T12:55:09.609318+0000","last_became_peered":"2024-04-16T12:55:09.609318+0000","last_unstale":"2024-04-16T12:55:16.367396+0000","last_undegraded":"2024-04-16T12:55:16.367396+0000","last_fullsized":"2024-04-16T12:55:16.367396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631556+0000","last_change":"2024-04-16T12:55:09.603666+0000","last_active":"2024-04-16T12:55:14.631556+0000","last_peered":"2024-04-16T12:55:14.631556+0000","last_clean":"2024-04-16T12:55:14.631556+0000","last_became_active":"2024-04-16T12:55:09.603143+0000","last_became_peered":"2024-04-16T12:55:09.603143+0000","last_unstale":"2024-04-16T12:55:14.631556+0000","last_undegraded":"2024-04-16T12:55:14.631556+0000","last_fullsized":"2024-04-16T12:55:14.631556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633935+0000","last_change":"2024-04-16T12:55:09.617882+0000","last_active":"2024-04-16T12:55:14.633935+0000","last_peered":"2024-04-16T12:55:14.633935+0000","last_clean":"2024-04-16T12:55:14.633935+0000","last_became_active":"2024-04-16T12:55:09.616769+0000","last_became_peered":"2024-04-16T12:55:09.616769+0000","last_unstale":"2024-04-16T12:55:14.633935+0000","last_undegraded":"2024-04-16T12:55:14.633935+0000","last_fullsized":"2024-04-16T12:55:14.633935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367223+0000","last_change":"2024-04-16T12:55:09.602044+0000","last_active":"2024-04-16T12:55:16.367223+0000","last_peered":"2024-04-16T12:55:16.367223+0000","last_clean":"2024-04-16T12:55:16.367223+0000","last_became_active":"2024-04-16T12:55:09.601747+0000","last_became_peered":"2024-04-16T12:55:09.601747+0000","last_unstale":"2024-04-16T12:55:16.367223+0000","last_undegraded":"2024-04-16T12:55:16.367223+0000","last_fullsized":"2024-04-16T12:55:16.367223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695371+0000","last_change":"2024-04-16T12:55:09.600028+0000","last_active":"2024-04-16T12:55:14.695371+0000","last_peered":"2024-04-16T12:55:14.695371+0000","last_clean":"2024-04-16T12:55:14.695371+0000","last_became_active":"2024-04-16T12:55:09.599747+0000","last_became_peered":"2024-04-16T12:55:09.599747+0000","last_unstale":"2024-04-16T12:55:14.695371+0000","last_undegraded":"2024-04-16T12:55:14.695371+0000","last_fullsized":"2024-04-16T12:55:14.695371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633104+0000","last_change":"2024-04-16T12:55:09.612581+0000","last_active":"2024-04-16T12:55:14.633104+0000","last_peered":"2024-04-16T12:55:14.633104+0000","last_clean":"2024-04-16T12:55:14.633104+0000","last_became_active":"2024-04-16T12:55:09.612244+0000","last_became_peered":"2024-04-16T12:55:09.612244+0000","last_unstale":"2024-04-16T12:55:14.633104+0000","last_undegraded":"2024-04-16T12:55:14.633104+0000","last_fullsized":"2024-04-16T12:55:14.633104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369155+0000","last_change":"2024-04-16T12:55:09.611077+0000","last_active":"2024-04-16T12:55:16.369155+0000","last_peered":"2024-04-16T12:55:16.369155+0000","last_clean":"2024-04-16T12:55:16.369155+0000","last_became_active":"2024-04-16T12:55:09.610542+0000","last_became_peered":"2024-04-16T12:55:09.610542+0000","last_unstale":"2024-04-16T12:55:16.369155+0000","last_undegraded":"2024-04-16T12:55:16.369155+0000","last_fullsized":"2024-04-16T12:55:16.369155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695447+0000","last_change":"2024-04-16T12:55:09.600725+0000","last_active":"2024-04-16T12:55:14.695447+0000","last_peered":"2024-04-16T12:55:14.695447+0000","last_clean":"2024-04-16T12:55:14.695447+0000","last_became_active":"2024-04-16T12:55:09.600418+0000","last_became_peered":"2024-04-16T12:55:09.600418+0000","last_unstale":"2024-04-16T12:55:14.695447+0000","last_undegraded":"2024-04-16T12:55:14.695447+0000","last_fullsized":"2024-04-16T12:55:14.695447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633340+0000","last_change":"2024-04-16T12:55:09.616346+0000","last_active":"2024-04-16T12:55:14.633340+0000","last_peered":"2024-04-16T12:55:14.633340+0000","last_clean":"2024-04-16T12:55:14.633340+0000","last_became_active":"2024-04-16T12:55:09.615328+0000","last_became_peered":"2024-04-16T12:55:09.615328+0000","last_unstale":"2024-04-16T12:55:14.633340+0000","last_undegraded":"2024-04-16T12:55:14.633340+0000","last_fullsized":"2024-04-16T12:55:14.633340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694859+0000","last_change":"2024-04-16T12:55:09.597852+0000","last_active":"2024-04-16T12:55:14.694859+0000","last_peered":"2024-04-16T12:55:14.694859+0000","last_clean":"2024-04-16T12:55:14.694859+0000","last_became_active":"2024-04-16T12:55:09.597466+0000","last_became_peered":"2024-04-16T12:55:09.597466+0000","last_unstale":"2024-04-16T12:55:14.694859+0000","last_undegraded":"2024-04-16T12:55:14.694859+0000","last_fullsized":"2024-04-16T12:55:14.694859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633627+0000","last_change":"2024-04-16T12:55:09.610381+0000","last_active":"2024-04-16T12:55:14.633627+0000","last_peered":"2024-04-16T12:55:14.633627+0000","last_clean":"2024-04-16T12:55:14.633627+0000","last_became_active":"2024-04-16T12:55:09.610124+0000","last_became_peered":"2024-04-16T12:55:09.610124+0000","last_unstale":"2024-04-16T12:55:14.633627+0000","last_undegraded":"2024-04-16T12:55:14.633627+0000","last_fullsized":"2024-04-16T12:55:14.633627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367062+0000","last_change":"2024-04-16T12:55:09.616215+0000","last_active":"2024-04-16T12:55:16.367062+0000","last_peered":"2024-04-16T12:55:16.367062+0000","last_clean":"2024-04-16T12:55:16.367062+0000","last_became_active":"2024-04-16T12:55:09.615568+0000","last_became_peered":"2024-04-16T12:55:09.615568+0000","last_unstale":"2024-04-16T12:55:16.367062+0000","last_undegraded":"2024-04-16T12:55:16.367062+0000","last_fullsized":"2024-04-16T12:55:16.367062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369286+0000","last_change":"2024-04-16T12:55:09.617828+0000","last_active":"2024-04-16T12:55:16.369286+0000","last_peered":"2024-04-16T12:55:16.369286+0000","last_clean":"2024-04-16T12:55:16.369286+0000","last_became_active":"2024-04-16T12:55:09.617544+0000","last_became_peered":"2024-04-16T12:55:09.617544+0000","last_unstale":"2024-04-16T12:55:16.369286+0000","last_undegraded":"2024-04-16T12:55:16.369286+0000","last_fullsized":"2024-04-16T12:55:16.369286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368942+0000","last_change":"2024-04-16T12:55:09.612315+0000","last_active":"2024-04-16T12:55:16.368942+0000","last_peered":"2024-04-16T12:55:16.368942+0000","last_clean":"2024-04-16T12:55:16.368942+0000","last_became_active":"2024-04-16T12:55:09.612023+0000","last_became_peered":"2024-04-16T12:55:09.612023+0000","last_unstale":"2024-04-16T12:55:16.368942+0000","last_undegraded":"2024-04-16T12:55:16.368942+0000","last_fullsized":"2024-04-16T12:55:16.368942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:26.067302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632023+0000","last_change":"2024-04-16T12:55:09.609432+0000","last_active":"2024-04-16T12:55:14.632023+0000","last_peered":"2024-04-16T12:55:14.632023+0000","last_clean":"2024-04-16T12:55:14.632023+0000","last_became_active":"2024-04-16T12:55:09.609172+0000","last_became_peered":"2024-04-16T12:55:09.609172+0000","last_unstale":"2024-04-16T12:55:14.632023+0000","last_undegraded":"2024-04-16T12:55:14.632023+0000","last_fullsized":"2024-04-16T12:55:14.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634287+0000","last_change":"2024-04-16T12:55:09.607797+0000","last_active":"2024-04-16T12:55:14.634287+0000","last_peered":"2024-04-16T12:55:14.634287+0000","last_clean":"2024-04-16T12:55:14.634287+0000","last_became_active":"2024-04-16T12:55:09.607546+0000","last_became_peered":"2024-04-16T12:55:09.607546+0000","last_unstale":"2024-04-16T12:55:14.634287+0000","last_undegraded":"2024-04-16T12:55:14.634287+0000","last_fullsized":"2024-04-16T12:55:14.634287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633202+0000","last_change":"2024-04-16T12:55:09.613594+0000","last_active":"2024-04-16T12:55:14.633202+0000","last_peered":"2024-04-16T12:55:14.633202+0000","last_clean":"2024-04-16T12:55:14.633202+0000","last_became_active":"2024-04-16T12:55:09.613296+0000","last_became_peered":"2024-04-16T12:55:09.613296+0000","last_unstale":"2024-04-16T12:55:14.633202+0000","last_undegraded":"2024-04-16T12:55:14.633202+0000","last_fullsized":"2024-04-16T12:55:14.633202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632804+0000","last_change":"2024-04-16T12:55:09.613823+0000","last_active":"2024-04-16T12:55:14.632804+0000","last_peered":"2024-04-16T12:55:14.632804+0000","last_clean":"2024-04-16T12:55:14.632804+0000","last_became_active":"2024-04-16T12:55:09.613460+0000","last_became_peered":"2024-04-16T12:55:09.613460+0000","last_unstale":"2024-04-16T12:55:14.632804+0000","last_undegraded":"2024-04-16T12:55:14.632804+0000","last_fullsized":"2024-04-16T12:55:14.632804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367104+0000","last_change":"2024-04-16T12:55:09.605119+0000","last_active":"2024-04-16T12:55:16.367104+0000","last_peered":"2024-04-16T12:55:16.367104+0000","last_clean":"2024-04-16T12:55:16.367104+0000","last_became_active":"2024-04-16T12:55:09.604862+0000","last_became_peered":"2024-04-16T12:55:09.604862+0000","last_unstale":"2024-04-16T12:55:16.367104+0000","last_undegraded":"2024-04-16T12:55:16.367104+0000","last_fullsized":"2024-04-16T12:55:16.367104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:09.316326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694754+0000","last_change":"2024-04-16T12:55:09.605111+0000","last_active":"2024-04-16T12:55:14.694754+0000","last_peered":"2024-04-16T12:55:14.694754+0000","last_clean":"2024-04-16T12:55:14.694754+0000","last_became_active":"2024-04-16T12:55:09.604719+0000","last_became_peered":"2024-04-16T12:55:09.604719+0000","last_unstale":"2024-04-16T12:55:14.694754+0000","last_undegraded":"2024-04-16T12:55:14.694754+0000","last_fullsized":"2024-04-16T12:55:14.694754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368708+0000","last_change":"2024-04-16T12:55:09.608920+0000","last_active":"2024-04-16T12:55:16.368708+0000","last_peered":"2024-04-16T12:55:16.368708+0000","last_clean":"2024-04-16T12:55:16.368708+0000","last_became_active":"2024-04-16T12:55:09.608627+0000","last_became_peered":"2024-04-16T12:55:09.608627+0000","last_unstale":"2024-04-16T12:55:16.368708+0000","last_undegraded":"2024-04-16T12:55:16.368708+0000","last_fullsized":"2024-04-16T12:55:16.368708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369071+0000","last_change":"2024-04-16T12:55:09.619322+0000","last_active":"2024-04-16T12:55:16.369071+0000","last_peered":"2024-04-16T12:55:16.369071+0000","last_clean":"2024-04-16T12:55:16.369071+0000","last_became_active":"2024-04-16T12:55:09.619043+0000","last_became_peered":"2024-04-16T12:55:09.619043+0000","last_unstale":"2024-04-16T12:55:16.369071+0000","last_undegraded":"2024-04-16T12:55:16.369071+0000","last_fullsized":"2024-04-16T12:55:16.369071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369041+0000","last_change":"2024-04-16T12:55:09.618675+0000","last_active":"2024-04-16T12:55:16.369041+0000","last_peered":"2024-04-16T12:55:16.369041+0000","last_clean":"2024-04-16T12:55:16.369041+0000","last_became_active":"2024-04-16T12:55:09.618346+0000","last_became_peered":"2024-04-16T12:55:09.618346+0000","last_unstale":"2024-04-16T12:55:16.369041+0000","last_undegraded":"2024-04-16T12:55:16.369041+0000","last_fullsized":"2024-04-16T12:55:16.369041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368488+0000","last_change":"2024-04-16T12:55:09.616435+0000","last_active":"2024-04-16T12:55:16.368488+0000","last_peered":"2024-04-16T12:55:16.368488+0000","last_clean":"2024-04-16T12:55:16.368488+0000","last_became_active":"2024-04-16T12:55:09.616054+0000","last_became_peered":"2024-04-16T12:55:09.616054+0000","last_unstale":"2024-04-16T12:55:16.368488+0000","last_undegraded":"2024-04-16T12:55:16.368488+0000","last_fullsized":"2024-04-16T12:55:16.368488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694651+0000","last_change":"2024-04-16T12:55:09.616193+0000","last_active":"2024-04-16T12:55:14.694651+0000","last_peered":"2024-04-16T12:55:14.694651+0000","last_clean":"2024-04-16T12:55:14.694651+0000","last_became_active":"2024-04-16T12:55:09.615114+0000","last_became_peered":"2024-04-16T12:55:09.615114+0000","last_unstale":"2024-04-16T12:55:14.694651+0000","last_undegraded":"2024-04-16T12:55:14.694651+0000","last_fullsized":"2024-04-16T12:55:14.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368221+0000","last_change":"2024-04-16T12:55:09.612626+0000","last_active":"2024-04-16T12:55:16.368221+0000","last_peered":"2024-04-16T12:55:16.368221+0000","last_clean":"2024-04-16T12:55:16.368221+0000","last_became_active":"2024-04-16T12:55:09.612338+0000","last_became_peered":"2024-04-16T12:55:09.612338+0000","last_unstale":"2024-04-16T12:55:16.368221+0000","last_undegraded":"2024-04-16T12:55:16.368221+0000","last_fullsized":"2024-04-16T12:55:16.368221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633547+0000","last_change":"2024-04-16T12:55:09.613314+0000","last_active":"2024-04-16T12:55:14.633547+0000","last_peered":"2024-04-16T12:55:14.633547+0000","last_clean":"2024-04-16T12:55:14.633547+0000","last_became_active":"2024-04-16T12:55:09.613047+0000","last_became_peered":"2024-04-16T12:55:09.613047+0000","last_unstale":"2024-04-16T12:55:14.633547+0000","last_undegraded":"2024-04-16T12:55:14.633547+0000","last_fullsized":"2024-04-16T12:55:14.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368254+0000","last_change":"2024-04-16T12:55:09.612821+0000","last_active":"2024-04-16T12:55:16.368254+0000","last_peered":"2024-04-16T12:55:16.368254+0000","last_clean":"2024-04-16T12:55:16.368254+0000","last_became_active":"2024-04-16T12:55:09.612537+0000","last_became_peered":"2024-04-16T12:55:09.612537+0000","last_unstale":"2024-04-16T12:55:16.368254+0000","last_undegraded":"2024-04-16T12:55:16.368254+0000","last_fullsized":"2024-04-16T12:55:16.368254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633793+0000","last_change":"2024-04-16T12:55:09.616023+0000","last_active":"2024-04-16T12:55:14.633793+0000","last_peered":"2024-04-16T12:55:14.633793+0000","last_clean":"2024-04-16T12:55:14.633793+0000","last_became_active":"2024-04-16T12:55:09.615631+0000","last_became_peered":"2024-04-16T12:55:09.615631+0000","last_unstale":"2024-04-16T12:55:14.633793+0000","last_undegraded":"2024-04-16T12:55:14.633793+0000","last_fullsized":"2024-04-16T12:55:14.633793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367139+0000","last_change":"2024-04-16T12:55:09.595574+0000","last_active":"2024-04-16T12:55:16.367139+0000","last_peered":"2024-04-16T12:55:16.367139+0000","last_clean":"2024-04-16T12:55:16.367139+0000","last_became_active":"2024-04-16T12:55:09.595237+0000","last_became_peered":"2024-04-16T12:55:09.595237+0000","last_unstale":"2024-04-16T12:55:16.367139+0000","last_undegraded":"2024-04-16T12:55:16.367139+0000","last_fullsized":"2024-04-16T12:55:16.367139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633687+0000","last_change":"2024-04-16T12:55:09.609132+0000","last_active":"2024-04-16T12:55:14.633687+0000","last_peered":"2024-04-16T12:55:14.633687+0000","last_clean":"2024-04-16T12:55:14.633687+0000","last_became_active":"2024-04-16T12:55:09.608733+0000","last_became_peered":"2024-04-16T12:55:09.608733+0000","last_unstale":"2024-04-16T12:55:14.633687+0000","last_undegraded":"2024-04-16T12:55:14.633687+0000","last_fullsized":"2024-04-16T12:55:14.633687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368365+0000","last_change":"2024-04-16T12:55:09.617426+0000","last_active":"2024-04-16T12:55:16.368365+0000","last_peered":"2024-04-16T12:55:16.368365+0000","last_clean":"2024-04-16T12:55:16.368365+0000","last_became_active":"2024-04-16T12:55:09.616828+0000","last_became_peered":"2024-04-16T12:55:09.616828+0000","last_unstale":"2024-04-16T12:55:16.368365+0000","last_undegraded":"2024-04-16T12:55:16.368365+0000","last_fullsized":"2024-04-16T12:55:16.368365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:01.823408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":690366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":99416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":690422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:55:35.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:55:35.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.669+0000 7f5660d59640 1 Processor -- start 2024-04-16T12:55:35.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 -- start start 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f565c15b840 0x7f565c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c15bc20 0x7f565c0b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 0x7f565c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f565c0b2640 con 0x7f565c15b840 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f565c0b3da0 con 0x7f565c0b3820 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.670+0000 7f5660d59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f565c0b28c0 con 0x7f565c15bc20 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f565c15b840 0x7f565c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f565c15b840 0x7f565c0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39094/0 (socket says 172.21.15.18:39094) 2024-04-16T12:55:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 -- 172.21.15.18:0/3033472991 learned_addr learned my addr 172.21.15.18:0/3033472991 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565ad9d640 1 --2- 172.21.15.18:0/3033472991 >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 0x7f565c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f5653fff640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c15bc20 0x7f565c0b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 -- 172.21.15.18:0/3033472991 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c15bc20 msgr2=0x7f565c0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c15bc20 0x7f565c0b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 -- 172.21.15.18:0/3033472991 >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 msgr2=0x7f565c06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:35.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 --2- 172.21.15.18:0/3033472991 >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 0x7f565c06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565a59c640 1 -- 172.21.15.18:0/3033472991 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c0b2ba0 con 0x7f565c15b840 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.671+0000 7f565ad9d640 1 --2- 172.21.15.18:0/3033472991 >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 0x7f565c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f565a59c640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c0cf190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f565c0cbba0 tx=0x7f564c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc56617e44df0a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5659d9b640 1 -- 172.21.15.18:0/3033472991 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c02e070 con 0x7f565c15b840 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5659d9b640 1 -- 172.21.15.18:0/3033472991 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c037070 con 0x7f565c15b840 2024-04-16T12:55:35.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5659d9b640 1 -- 172.21.15.18:0/3033472991 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c031a00 con 0x7f565c15b840 2024-04-16T12:55:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 -- 172.21.15.18:0/3033472991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 msgr2=0x7f565c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c0cf190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f565c0cbba0 tx=0x7f564c02b880 comp rx=0 tx=0).stop 2024-04-16T12:55:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 -- 172.21.15.18:0/3033472991 shutdown_connections 2024-04-16T12:55:35.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 --2- 172.21.15.18:0/3033472991 >> v2:172.21.15.104:3300/0 conn(0x7f565c0b3820 0x7f565c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c15bc20 0x7f565c0b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 --2- 172.21.15.18:0/3033472991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c0cf190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 -- 172.21.15.18:0/3033472991 >> 172.21.15.18:0/3033472991 conn(0x7f565c09aa10 msgr2=0x7f565c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 -- 172.21.15.18:0/3033472991 shutdown_connections 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.672+0000 7f5660d59640 1 -- 172.21.15.18:0/3033472991 wait complete. 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 Processor -- start 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 -- start start 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c0b3820 0x7f565c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f565c1666a0 0x7f565c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f565c06e270 con 0x7f565c15b840 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f565c06e0f0 con 0x7f565c1666a0 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5660d59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f565c06e3f0 con 0x7f565c0b3820 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.674+0000 7f5653fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39106/0 (socket says 172.21.15.18:39106) 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 -- 172.21.15.18:0/3151797683 learned_addr learned my addr 172.21.15.18:0/3151797683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f565a59c640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c0b3820 0x7f565c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f565ad9d640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f565c1666a0 0x7f565c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 -- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c0b3820 msgr2=0x7f565c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c0b3820 0x7f565c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 -- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f565c1666a0 msgr2=0x7f565c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f565c1666a0 0x7f565c153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 -- 172.21.15.18:0/3151797683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c153a80 con 0x7f565c15b840 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5653fff640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f564400c820 tx=0x7f564400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644015070 con 0x7f565c15b840 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5644004240 con 0x7f565c15b840 2024-04-16T12:55:35.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565c0ccd00 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564400ce10 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.675+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565c0cd2c0 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.676+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565c068a70 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.677+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5644007830 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.677+0000 7f5652ffd640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 0x7f563c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.677+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f564408bd30 con 0x7f565c15b840 2024-04-16T12:55:35.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.677+0000 7f565a59c640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 0x7f563c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.678+0000 7f565a59c640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 0x7f563c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f564c036000 tx=0x7f564c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.681+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5644059e20 con 0x7f565c15b840 2024-04-16T12:55:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.864+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f565c1562b0 con 0x7f563c06c8f0 2024-04-16T12:55:35.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.873+0000 7f5652ffd640 1 -- 172.21.15.18:0/3151797683 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332529 (secure 0 0 0) 0x7f565c1562b0 con 0x7f563c06c8f0 2024-04-16T12:55:35.878 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 msgr2=0x7f563c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 0x7f563c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f564c036000 tx=0x7f564c03d040 comp rx=0 tx=0).stop 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 msgr2=0x7f565c152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f564400c820 tx=0x7f564400cce0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 shutdown_connections 2024-04-16T12:55:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f563c06c8f0 0x7f563c06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f565c1666a0 0x7f565c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c15b840 0x7f565c152ae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 --2- 172.21.15.18:0/3151797683 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f565c0b3820 0x7f565c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 >> 172.21.15.18:0/3151797683 conn(0x7f565c09aa10 msgr2=0x7f565c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 shutdown_connections 2024-04-16T12:55:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:35.876+0000 7f5660d59640 1 -- 172.21.15.18:0/3151797683 wait complete. 2024-04-16T12:55:35.890 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-16T12:55:34.525012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231816,"kb_used_data":3176,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742904,"statfs":{"total":773094113280,"available":772856733696,"internally_reserved":0,"allocated":3252224,"data_stored":1985344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367479+0000","last_change":"2024-04-16T12:55:08.601362+0000","last_active":"2024-04-16T12:55:16.367479+0000","last_peered":"2024-04-16T12:55:16.367479+0000","last_clean":"2024-04-16T12:55:16.367479+0000","last_became_active":"2024-04-16T12:55:08.601067+0000","last_became_peered":"2024-04-16T12:55:08.601067+0000","last_unstale":"2024-04-16T12:55:16.367479+0000","last_undegraded":"2024-04-16T12:55:16.367479+0000","last_fullsized":"2024-04-16T12:55:16.367479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695218+0000","last_change":"2024-04-16T12:55:09.615816+0000","last_active":"2024-04-16T12:55:14.695218+0000","last_peered":"2024-04-16T12:55:14.695218+0000","last_clean":"2024-04-16T12:55:14.695218+0000","last_became_active":"2024-04-16T12:55:09.615467+0000","last_became_peered":"2024-04-16T12:55:09.615467+0000","last_unstale":"2024-04-16T12:55:14.695218+0000","last_undegraded":"2024-04-16T12:55:14.695218+0000","last_fullsized":"2024-04-16T12:55:14.695218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694776+0000","last_change":"2024-04-16T12:55:13.983588+0000","last_active":"2024-04-16T12:55:14.694776+0000","last_peered":"2024-04-16T12:55:14.694776+0000","last_clean":"2024-04-16T12:55:14.694776+0000","last_became_active":"2024-04-16T12:55:13.982853+0000","last_became_peered":"2024-04-16T12:55:13.982853+0000","last_unstale":"2024-04-16T12:55:14.694776+0000","last_undegraded":"2024-04-16T12:55:14.694776+0000","last_fullsized":"2024-04-16T12:55:14.694776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695423+0000","last_change":"2024-04-16T12:55:08.604046+0000","last_active":"2024-04-16T12:55:14.695423+0000","last_peered":"2024-04-16T12:55:14.695423+0000","last_clean":"2024-04-16T12:55:14.695423+0000","last_became_active":"2024-04-16T12:55:08.603686+0000","last_became_peered":"2024-04-16T12:55:08.603686+0000","last_unstale":"2024-04-16T12:55:14.695423+0000","last_undegraded":"2024-04-16T12:55:14.695423+0000","last_fullsized":"2024-04-16T12:55:14.695423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:09.977524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367376+0000","last_change":"2024-04-16T12:55:09.603388+0000","last_active":"2024-04-16T12:55:16.367376+0000","last_peered":"2024-04-16T12:55:16.367376+0000","last_clean":"2024-04-16T12:55:16.367376+0000","last_became_active":"2024-04-16T12:55:09.603127+0000","last_became_peered":"2024-04-16T12:55:09.603127+0000","last_unstale":"2024-04-16T12:55:16.367376+0000","last_undegraded":"2024-04-16T12:55:16.367376+0000","last_fullsized":"2024-04-16T12:55:16.367376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368880+0000","last_change":"2024-04-16T12:55:13.640798+0000","last_active":"2024-04-16T12:55:16.368880+0000","last_peered":"2024-04-16T12:55:16.368880+0000","last_clean":"2024-04-16T12:55:16.368880+0000","last_became_active":"2024-04-16T12:55:13.640396+0000","last_became_peered":"2024-04-16T12:55:13.640396+0000","last_unstale":"2024-04-16T12:55:16.368880+0000","last_undegraded":"2024-04-16T12:55:16.368880+0000","last_fullsized":"2024-04-16T12:55:16.368880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:30.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368816+0000","last_change":"2024-04-16T12:55:08.603812+0000","last_active":"2024-04-16T12:55:16.368816+0000","last_peered":"2024-04-16T12:55:16.368816+0000","last_clean":"2024-04-16T12:55:16.368816+0000","last_became_active":"2024-04-16T12:55:08.603521+0000","last_became_peered":"2024-04-16T12:55:08.603521+0000","last_unstale":"2024-04-16T12:55:16.368816+0000","last_undegraded":"2024-04-16T12:55:16.368816+0000","last_fullsized":"2024-04-16T12:55:16.368816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:29.707733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633822+0000","last_change":"2024-04-16T12:55:09.599628+0000","last_active":"2024-04-16T12:55:14.633822+0000","last_peered":"2024-04-16T12:55:14.633822+0000","last_clean":"2024-04-16T12:55:14.633822+0000","last_became_active":"2024-04-16T12:55:09.599322+0000","last_became_peered":"2024-04-16T12:55:09.599322+0000","last_unstale":"2024-04-16T12:55:14.633822+0000","last_undegraded":"2024-04-16T12:55:14.633822+0000","last_fullsized":"2024-04-16T12:55:14.633822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369484+0000","last_change":"2024-04-16T12:55:13.644781+0000","last_active":"2024-04-16T12:55:16.369484+0000","last_peered":"2024-04-16T12:55:16.369484+0000","last_clean":"2024-04-16T12:55:16.369484+0000","last_became_active":"2024-04-16T12:55:13.644284+0000","last_became_peered":"2024-04-16T12:55:13.644284+0000","last_unstale":"2024-04-16T12:55:16.369484+0000","last_undegraded":"2024-04-16T12:55:16.369484+0000","last_fullsized":"2024-04-16T12:55:16.369484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367966+0000","last_change":"2024-04-16T12:55:08.606441+0000","last_active":"2024-04-16T12:55:16.367966+0000","last_peered":"2024-04-16T12:55:16.367966+0000","last_clean":"2024-04-16T12:55:16.367966+0000","last_became_active":"2024-04-16T12:55:08.606162+0000","last_became_peered":"2024-04-16T12:55:08.606162+0000","last_unstale":"2024-04-16T12:55:16.367966+0000","last_undegraded":"2024-04-16T12:55:16.367966+0000","last_fullsized":"2024-04-16T12:55:16.367966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634055+0000","last_change":"2024-04-16T12:55:09.605124+0000","last_active":"2024-04-16T12:55:14.634055+0000","last_peered":"2024-04-16T12:55:14.634055+0000","last_clean":"2024-04-16T12:55:14.634055+0000","last_became_active":"2024-04-16T12:55:09.604225+0000","last_became_peered":"2024-04-16T12:55:09.604225+0000","last_unstale":"2024-04-16T12:55:14.634055+0000","last_undegraded":"2024-04-16T12:55:14.634055+0000","last_fullsized":"2024-04-16T12:55:14.634055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367712+0000","last_change":"2024-04-16T12:55:13.643994+0000","last_active":"2024-04-16T12:55:16.367712+0000","last_peered":"2024-04-16T12:55:16.367712+0000","last_clean":"2024-04-16T12:55:16.367712+0000","last_became_active":"2024-04-16T12:55:13.643551+0000","last_became_peered":"2024-04-16T12:55:13.643551+0000","last_unstale":"2024-04-16T12:55:16.367712+0000","last_undegraded":"2024-04-16T12:55:16.367712+0000","last_fullsized":"2024-04-16T12:55:16.367712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:07.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368044+0000","last_change":"2024-04-16T12:55:09.617118+0000","last_active":"2024-04-16T12:55:16.368044+0000","last_peered":"2024-04-16T12:55:16.368044+0000","last_clean":"2024-04-16T12:55:16.368044+0000","last_became_active":"2024-04-16T12:55:09.616808+0000","last_became_peered":"2024-04-16T12:55:09.616808+0000","last_unstale":"2024-04-16T12:55:16.368044+0000","last_undegraded":"2024-04-16T12:55:16.368044+0000","last_fullsized":"2024-04-16T12:55:16.368044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368824+0000","last_change":"2024-04-16T12:55:08.602196+0000","last_active":"2024-04-16T12:55:16.368824+0000","last_peered":"2024-04-16T12:55:16.368824+0000","last_clean":"2024-04-16T12:55:16.368824+0000","last_became_active":"2024-04-16T12:55:08.601896+0000","last_became_peered":"2024-04-16T12:55:08.601896+0000","last_unstale":"2024-04-16T12:55:16.368824+0000","last_undegraded":"2024-04-16T12:55:16.368824+0000","last_fullsized":"2024-04-16T12:55:16.368824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:44.870969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368907+0000","last_change":"2024-04-16T12:55:13.642915+0000","last_active":"2024-04-16T12:55:16.368907+0000","last_peered":"2024-04-16T12:55:16.368907+0000","last_clean":"2024-04-16T12:55:16.368907+0000","last_became_active":"2024-04-16T12:55:13.642404+0000","last_became_peered":"2024-04-16T12:55:13.642404+0000","last_unstale":"2024-04-16T12:55:16.368907+0000","last_undegraded":"2024-04-16T12:55:16.368907+0000","last_fullsized":"2024-04-16T12:55:16.368907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:12.774418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694920+0000","last_change":"2024-04-16T12:55:09.609312+0000","last_active":"2024-04-16T12:55:14.694920+0000","last_peered":"2024-04-16T12:55:14.694920+0000","last_clean":"2024-04-16T12:55:14.694920+0000","last_became_active":"2024-04-16T12:55:09.608972+0000","last_became_peered":"2024-04-16T12:55:09.608972+0000","last_unstale":"2024-04-16T12:55:14.694920+0000","last_undegraded":"2024-04-16T12:55:14.694920+0000","last_fullsized":"2024-04-16T12:55:14.694920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633101+0000","last_change":"2024-04-16T12:55:08.604374+0000","last_active":"2024-04-16T12:55:14.633101+0000","last_peered":"2024-04-16T12:55:14.633101+0000","last_clean":"2024-04-16T12:55:14.633101+0000","last_became_active":"2024-04-16T12:55:08.603813+0000","last_became_peered":"2024-04-16T12:55:08.603813+0000","last_unstale":"2024-04-16T12:55:14.633101+0000","last_undegraded":"2024-04-16T12:55:14.633101+0000","last_fullsized":"2024-04-16T12:55:14.633101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368459+0000","last_change":"2024-04-16T12:55:13.643708+0000","last_active":"2024-04-16T12:55:16.368459+0000","last_peered":"2024-04-16T12:55:16.368459+0000","last_clean":"2024-04-16T12:55:16.368459+0000","last_became_active":"2024-04-16T12:55:13.643298+0000","last_became_peered":"2024-04-16T12:55:13.643298+0000","last_unstale":"2024-04-16T12:55:16.368459+0000","last_undegraded":"2024-04-16T12:55:16.368459+0000","last_fullsized":"2024-04-16T12:55:16.368459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:46.270789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694839+0000","last_change":"2024-04-16T12:55:09.608016+0000","last_active":"2024-04-16T12:55:14.694839+0000","last_peered":"2024-04-16T12:55:14.694839+0000","last_clean":"2024-04-16T12:55:14.694839+0000","last_became_active":"2024-04-16T12:55:09.607708+0000","last_became_peered":"2024-04-16T12:55:09.607708+0000","last_unstale":"2024-04-16T12:55:14.694839+0000","last_undegraded":"2024-04-16T12:55:14.694839+0000","last_fullsized":"2024-04-16T12:55:14.694839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632908+0000","last_change":"2024-04-16T12:55:08.604999+0000","last_active":"2024-04-16T12:55:14.632908+0000","last_peered":"2024-04-16T12:55:14.632908+0000","last_clean":"2024-04-16T12:55:14.632908+0000","last_became_active":"2024-04-16T12:55:08.603479+0000","last_became_peered":"2024-04-16T12:55:08.603479+0000","last_unstale":"2024-04-16T12:55:14.632908+0000","last_undegraded":"2024-04-16T12:55:14.632908+0000","last_fullsized":"2024-04-16T12:55:14.632908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633683+0000","last_change":"2024-04-16T12:55:13.984277+0000","last_active":"2024-04-16T12:55:14.633683+0000","last_peered":"2024-04-16T12:55:14.633683+0000","last_clean":"2024-04-16T12:55:14.633683+0000","last_became_active":"2024-04-16T12:55:13.983911+0000","last_became_peered":"2024-04-16T12:55:13.983911+0000","last_unstale":"2024-04-16T12:55:14.633683+0000","last_undegraded":"2024-04-16T12:55:14.633683+0000","last_fullsized":"2024-04-16T12:55:14.633683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369689+0000","last_change":"2024-04-16T12:55:09.597064+0000","last_active":"2024-04-16T12:55:16.369689+0000","last_peered":"2024-04-16T12:55:16.369689+0000","last_clean":"2024-04-16T12:55:16.369689+0000","last_became_active":"2024-04-16T12:55:09.596531+0000","last_became_peered":"2024-04-16T12:55:09.596531+0000","last_unstale":"2024-04-16T12:55:16.369689+0000","last_undegraded":"2024-04-16T12:55:16.369689+0000","last_fullsized":"2024-04-16T12:55:16.369689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:41.388856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368817+0000","last_change":"2024-04-16T12:55:08.602603+0000","last_active":"2024-04-16T12:55:16.368817+0000","last_peered":"2024-04-16T12:55:16.368817+0000","last_clean":"2024-04-16T12:55:16.368817+0000","last_became_active":"2024-04-16T12:55:08.602324+0000","last_became_peered":"2024-04-16T12:55:08.602324+0000","last_unstale":"2024-04-16T12:55:16.368817+0000","last_undegraded":"2024-04-16T12:55:16.368817+0000","last_fullsized":"2024-04-16T12:55:16.368817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369344+0000","last_change":"2024-04-16T12:55:13.644854+0000","last_active":"2024-04-16T12:55:16.369344+0000","last_peered":"2024-04-16T12:55:16.369344+0000","last_clean":"2024-04-16T12:55:16.369344+0000","last_became_active":"2024-04-16T12:55:13.644347+0000","last_became_peered":"2024-04-16T12:55:13.644347+0000","last_unstale":"2024-04-16T12:55:16.369344+0000","last_undegraded":"2024-04-16T12:55:16.369344+0000","last_fullsized":"2024-04-16T12:55:16.369344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367451+0000","last_change":"2024-04-16T12:55:09.607401+0000","last_active":"2024-04-16T12:55:16.367451+0000","last_peered":"2024-04-16T12:55:16.367451+0000","last_clean":"2024-04-16T12:55:16.367451+0000","last_became_active":"2024-04-16T12:55:09.607073+0000","last_became_peered":"2024-04-16T12:55:09.607073+0000","last_unstale":"2024-04-16T12:55:16.367451+0000","last_undegraded":"2024-04-16T12:55:16.367451+0000","last_fullsized":"2024-04-16T12:55:16.367451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369471+0000","last_change":"2024-04-16T12:55:08.604773+0000","last_active":"2024-04-16T12:55:16.369471+0000","last_peered":"2024-04-16T12:55:16.369471+0000","last_clean":"2024-04-16T12:55:16.369471+0000","last_became_active":"2024-04-16T12:55:08.604275+0000","last_became_peered":"2024-04-16T12:55:08.604275+0000","last_unstale":"2024-04-16T12:55:16.369471+0000","last_undegraded":"2024-04-16T12:55:16.369471+0000","last_fullsized":"2024-04-16T12:55:16.369471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369565+0000","last_change":"2024-04-16T12:55:13.984733+0000","last_active":"2024-04-16T12:55:16.369565+0000","last_peered":"2024-04-16T12:55:16.369565+0000","last_clean":"2024-04-16T12:55:16.369565+0000","last_became_active":"2024-04-16T12:55:13.983970+0000","last_became_peered":"2024-04-16T12:55:13.983970+0000","last_unstale":"2024-04-16T12:55:16.369565+0000","last_undegraded":"2024-04-16T12:55:16.369565+0000","last_fullsized":"2024-04-16T12:55:16.369565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695546+0000","last_change":"2024-04-16T12:55:09.612698+0000","last_active":"2024-04-16T12:55:14.695546+0000","last_peered":"2024-04-16T12:55:14.695546+0000","last_clean":"2024-04-16T12:55:14.695546+0000","last_became_active":"2024-04-16T12:55:09.612401+0000","last_became_peered":"2024-04-16T12:55:09.612401+0000","last_unstale":"2024-04-16T12:55:14.695546+0000","last_undegraded":"2024-04-16T12:55:14.695546+0000","last_fullsized":"2024-04-16T12:55:14.695546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633691+0000","last_change":"2024-04-16T12:55:08.602265+0000","last_active":"2024-04-16T12:55:14.633691+0000","last_peered":"2024-04-16T12:55:14.633691+0000","last_clean":"2024-04-16T12:55:14.633691+0000","last_became_active":"2024-04-16T12:55:08.601969+0000","last_became_peered":"2024-04-16T12:55:08.601969+0000","last_unstale":"2024-04-16T12:55:14.633691+0000","last_undegraded":"2024-04-16T12:55:14.633691+0000","last_fullsized":"2024-04-16T12:55:14.633691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694594+0000","last_change":"2024-04-16T12:55:13.981871+0000","last_active":"2024-04-16T12:55:14.694594+0000","last_peered":"2024-04-16T12:55:14.694594+0000","last_clean":"2024-04-16T12:55:14.694594+0000","last_became_active":"2024-04-16T12:55:13.981491+0000","last_became_peered":"2024-04-16T12:55:13.981491+0000","last_unstale":"2024-04-16T12:55:14.694594+0000","last_undegraded":"2024-04-16T12:55:14.694594+0000","last_fullsized":"2024-04-16T12:55:14.694594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:58.777887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633569+0000","last_change":"2024-04-16T12:55:09.608036+0000","last_active":"2024-04-16T12:55:14.633569+0000","last_peered":"2024-04-16T12:55:14.633569+0000","last_clean":"2024-04-16T12:55:14.633569+0000","last_became_active":"2024-04-16T12:55:09.607748+0000","last_became_peered":"2024-04-16T12:55:09.607748+0000","last_unstale":"2024-04-16T12:55:14.633569+0000","last_undegraded":"2024-04-16T12:55:14.633569+0000","last_fullsized":"2024-04-16T12:55:14.633569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368966+0000","last_change":"2024-04-16T12:55:08.606601+0000","last_active":"2024-04-16T12:55:16.368966+0000","last_peered":"2024-04-16T12:55:16.368966+0000","last_clean":"2024-04-16T12:55:16.368966+0000","last_became_active":"2024-04-16T12:55:08.606293+0000","last_became_peered":"2024-04-16T12:55:08.606293+0000","last_unstale":"2024-04-16T12:55:16.368966+0000","last_undegraded":"2024-04-16T12:55:16.368966+0000","last_fullsized":"2024-04-16T12:55:16.368966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:02.120498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367098+0000","last_change":"2024-04-16T12:55:13.981993+0000","last_active":"2024-04-16T12:55:16.367098+0000","last_peered":"2024-04-16T12:55:16.367098+0000","last_clean":"2024-04-16T12:55:16.367098+0000","last_became_active":"2024-04-16T12:55:13.981384+0000","last_became_peered":"2024-04-16T12:55:13.981384+0000","last_unstale":"2024-04-16T12:55:16.367098+0000","last_undegraded":"2024-04-16T12:55:16.367098+0000","last_fullsized":"2024-04-16T12:55:16.367098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634120+0000","last_change":"2024-04-16T12:55:09.616638+0000","last_active":"2024-04-16T12:55:14.634120+0000","last_peered":"2024-04-16T12:55:14.634120+0000","last_clean":"2024-04-16T12:55:14.634120+0000","last_became_active":"2024-04-16T12:55:09.616217+0000","last_became_peered":"2024-04-16T12:55:09.616217+0000","last_unstale":"2024-04-16T12:55:14.634120+0000","last_undegraded":"2024-04-16T12:55:14.634120+0000","last_fullsized":"2024-04-16T12:55:14.634120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633590+0000","last_change":"2024-04-16T12:55:08.598000+0000","last_active":"2024-04-16T12:55:14.633590+0000","last_peered":"2024-04-16T12:55:14.633590+0000","last_clean":"2024-04-16T12:55:14.633590+0000","last_became_active":"2024-04-16T12:55:08.597703+0000","last_became_peered":"2024-04-16T12:55:08.597703+0000","last_unstale":"2024-04-16T12:55:14.633590+0000","last_undegraded":"2024-04-16T12:55:14.633590+0000","last_fullsized":"2024-04-16T12:55:14.633590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632782+0000","last_change":"2024-04-16T12:55:13.646625+0000","last_active":"2024-04-16T12:55:14.632782+0000","last_peered":"2024-04-16T12:55:14.632782+0000","last_clean":"2024-04-16T12:55:14.632782+0000","last_became_active":"2024-04-16T12:55:13.646260+0000","last_became_peered":"2024-04-16T12:55:13.646260+0000","last_unstale":"2024-04-16T12:55:14.632782+0000","last_undegraded":"2024-04-16T12:55:14.632782+0000","last_fullsized":"2024-04-16T12:55:14.632782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369676+0000","last_change":"2024-04-16T12:55:09.600934+0000","last_active":"2024-04-16T12:55:16.369676+0000","last_peered":"2024-04-16T12:55:16.369676+0000","last_clean":"2024-04-16T12:55:16.369676+0000","last_became_active":"2024-04-16T12:55:09.600399+0000","last_became_peered":"2024-04-16T12:55:09.600399+0000","last_unstale":"2024-04-16T12:55:16.369676+0000","last_undegraded":"2024-04-16T12:55:16.369676+0000","last_fullsized":"2024-04-16T12:55:16.369676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:43.700295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633893+0000","last_change":"2024-04-16T12:55:08.604212+0000","last_active":"2024-04-16T12:55:14.633893+0000","last_peered":"2024-04-16T12:55:14.633893+0000","last_clean":"2024-04-16T12:55:14.633893+0000","last_became_active":"2024-04-16T12:55:08.603941+0000","last_became_peered":"2024-04-16T12:55:08.603941+0000","last_unstale":"2024-04-16T12:55:14.633893+0000","last_undegraded":"2024-04-16T12:55:14.633893+0000","last_fullsized":"2024-04-16T12:55:14.633893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633482+0000","last_change":"2024-04-16T12:55:13.648783+0000","last_active":"2024-04-16T12:55:14.633482+0000","last_peered":"2024-04-16T12:55:14.633482+0000","last_clean":"2024-04-16T12:55:14.633482+0000","last_became_active":"2024-04-16T12:55:13.648394+0000","last_became_peered":"2024-04-16T12:55:13.648394+0000","last_unstale":"2024-04-16T12:55:14.633482+0000","last_undegraded":"2024-04-16T12:55:14.633482+0000","last_fullsized":"2024-04-16T12:55:14.633482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633151+0000","last_change":"2024-04-16T12:55:09.610829+0000","last_active":"2024-04-16T12:55:14.633151+0000","last_peered":"2024-04-16T12:55:14.633151+0000","last_clean":"2024-04-16T12:55:14.633151+0000","last_became_active":"2024-04-16T12:55:09.607200+0000","last_became_peered":"2024-04-16T12:55:09.607200+0000","last_unstale":"2024-04-16T12:55:14.633151+0000","last_undegraded":"2024-04-16T12:55:14.633151+0000","last_fullsized":"2024-04-16T12:55:14.633151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631656+0000","last_change":"2024-04-16T12:55:08.604218+0000","last_active":"2024-04-16T12:55:14.631656+0000","last_peered":"2024-04-16T12:55:14.631656+0000","last_clean":"2024-04-16T12:55:14.631656+0000","last_became_active":"2024-04-16T12:55:08.603910+0000","last_became_peered":"2024-04-16T12:55:08.603910+0000","last_unstale":"2024-04-16T12:55:14.631656+0000","last_undegraded":"2024-04-16T12:55:14.631656+0000","last_fullsized":"2024-04-16T12:55:14.631656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:40.383778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633704+0000","last_change":"2024-04-16T12:55:13.647025+0000","last_active":"2024-04-16T12:55:14.633704+0000","last_peered":"2024-04-16T12:55:14.633704+0000","last_clean":"2024-04-16T12:55:14.633704+0000","last_became_active":"2024-04-16T12:55:13.646214+0000","last_became_peered":"2024-04-16T12:55:13.646214+0000","last_unstale":"2024-04-16T12:55:14.633704+0000","last_undegraded":"2024-04-16T12:55:14.633704+0000","last_fullsized":"2024-04-16T12:55:14.633704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.366914+0000","last_change":"2024-04-16T12:55:09.600161+0000","last_active":"2024-04-16T12:55:16.366914+0000","last_peered":"2024-04-16T12:55:16.366914+0000","last_clean":"2024-04-16T12:55:16.366914+0000","last_became_active":"2024-04-16T12:55:09.599040+0000","last_became_peered":"2024-04-16T12:55:09.599040+0000","last_unstale":"2024-04-16T12:55:16.366914+0000","last_undegraded":"2024-04-16T12:55:16.366914+0000","last_fullsized":"2024-04-16T12:55:16.366914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:14:03.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369035+0000","last_change":"2024-04-16T12:55:08.602446+0000","last_active":"2024-04-16T12:55:16.369035+0000","last_peered":"2024-04-16T12:55:16.369035+0000","last_clean":"2024-04-16T12:55:16.369035+0000","last_became_active":"2024-04-16T12:55:08.602174+0000","last_became_peered":"2024-04-16T12:55:08.602174+0000","last_unstale":"2024-04-16T12:55:16.369035+0000","last_undegraded":"2024-04-16T12:55:16.369035+0000","last_fullsized":"2024-04-16T12:55:16.369035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367361+0000","last_change":"2024-04-16T12:55:13.981927+0000","last_active":"2024-04-16T12:55:16.367361+0000","last_peered":"2024-04-16T12:55:16.367361+0000","last_clean":"2024-04-16T12:55:16.367361+0000","last_became_active":"2024-04-16T12:55:13.981550+0000","last_became_peered":"2024-04-16T12:55:13.981550+0000","last_unstale":"2024-04-16T12:55:16.367361+0000","last_undegraded":"2024-04-16T12:55:16.367361+0000","last_fullsized":"2024-04-16T12:55:16.367361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:30.099478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694649+0000","last_change":"2024-04-16T12:55:09.615938+0000","last_active":"2024-04-16T12:55:14.694649+0000","last_peered":"2024-04-16T12:55:14.694649+0000","last_clean":"2024-04-16T12:55:14.694649+0000","last_became_active":"2024-04-16T12:55:09.615177+0000","last_became_peered":"2024-04-16T12:55:09.615177+0000","last_unstale":"2024-04-16T12:55:14.694649+0000","last_undegraded":"2024-04-16T12:55:14.694649+0000","last_fullsized":"2024-04-16T12:55:14.694649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633571+0000","last_change":"2024-04-16T12:55:08.599197+0000","last_active":"2024-04-16T12:55:14.633571+0000","last_peered":"2024-04-16T12:55:14.633571+0000","last_clean":"2024-04-16T12:55:14.633571+0000","last_became_active":"2024-04-16T12:55:08.598892+0000","last_became_peered":"2024-04-16T12:55:08.598892+0000","last_unstale":"2024-04-16T12:55:14.633571+0000","last_undegraded":"2024-04-16T12:55:14.633571+0000","last_fullsized":"2024-04-16T12:55:14.633571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368934+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:55:16.368934+0000","last_peered":"2024-04-16T12:55:16.368934+0000","last_clean":"2024-04-16T12:55:16.368934+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:55:16.368934+0000","last_undegraded":"2024-04-16T12:55:16.368934+0000","last_fullsized":"2024-04-16T12:55:16.368934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368883+0000","last_change":"2024-04-16T12:55:13.983109+0000","last_active":"2024-04-16T12:55:16.368883+0000","last_peered":"2024-04-16T12:55:16.368883+0000","last_clean":"2024-04-16T12:55:16.368883+0000","last_became_active":"2024-04-16T12:55:13.982685+0000","last_became_peered":"2024-04-16T12:55:13.982685+0000","last_unstale":"2024-04-16T12:55:16.368883+0000","last_undegraded":"2024-04-16T12:55:16.368883+0000","last_fullsized":"2024-04-16T12:55:16.368883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368489+0000","last_change":"2024-04-16T12:55:09.615455+0000","last_active":"2024-04-16T12:55:16.368489+0000","last_peered":"2024-04-16T12:55:16.368489+0000","last_clean":"2024-04-16T12:55:16.368489+0000","last_became_active":"2024-04-16T12:55:09.614879+0000","last_became_peered":"2024-04-16T12:55:09.614879+0000","last_unstale":"2024-04-16T12:55:16.368489+0000","last_undegraded":"2024-04-16T12:55:16.368489+0000","last_fullsized":"2024-04-16T12:55:16.368489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631857+0000","last_change":"2024-04-16T12:55:08.602417+0000","last_active":"2024-04-16T12:55:14.631857+0000","last_peered":"2024-04-16T12:55:14.631857+0000","last_clean":"2024-04-16T12:55:14.631857+0000","last_became_active":"2024-04-16T12:55:08.602116+0000","last_became_peered":"2024-04-16T12:55:08.602116+0000","last_unstale":"2024-04-16T12:55:14.631857+0000","last_undegraded":"2024-04-16T12:55:14.631857+0000","last_fullsized":"2024-04-16T12:55:14.631857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367931+0000","last_change":"2024-04-16T12:55:13.982825+0000","last_active":"2024-04-16T12:55:16.367931+0000","last_peered":"2024-04-16T12:55:16.367931+0000","last_clean":"2024-04-16T12:55:16.367931+0000","last_became_active":"2024-04-16T12:55:13.981463+0000","last_became_peered":"2024-04-16T12:55:13.981463+0000","last_unstale":"2024-04-16T12:55:16.367931+0000","last_undegraded":"2024-04-16T12:55:16.367931+0000","last_fullsized":"2024-04-16T12:55:16.367931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.633167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633956+0000","last_change":"2024-04-16T12:55:09.615888+0000","last_active":"2024-04-16T12:55:14.633956+0000","last_peered":"2024-04-16T12:55:14.633956+0000","last_clean":"2024-04-16T12:55:14.633956+0000","last_became_active":"2024-04-16T12:55:09.615272+0000","last_became_peered":"2024-04-16T12:55:09.615272+0000","last_unstale":"2024-04-16T12:55:14.633956+0000","last_undegraded":"2024-04-16T12:55:14.633956+0000","last_fullsized":"2024-04-16T12:55:14.633956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633411+0000","last_change":"2024-04-16T12:55:08.601281+0000","last_active":"2024-04-16T12:55:14.633411+0000","last_peered":"2024-04-16T12:55:14.633411+0000","last_clean":"2024-04-16T12:55:14.633411+0000","last_became_active":"2024-04-16T12:55:08.600899+0000","last_became_peered":"2024-04-16T12:55:08.600899+0000","last_unstale":"2024-04-16T12:55:14.633411+0000","last_undegraded":"2024-04-16T12:55:14.633411+0000","last_fullsized":"2024-04-16T12:55:14.633411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367245+0000","last_change":"2024-04-16T12:55:13.647207+0000","last_active":"2024-04-16T12:55:16.367245+0000","last_peered":"2024-04-16T12:55:16.367245+0000","last_clean":"2024-04-16T12:55:16.367245+0000","last_became_active":"2024-04-16T12:55:13.646389+0000","last_became_peered":"2024-04-16T12:55:13.646389+0000","last_unstale":"2024-04-16T12:55:16.367245+0000","last_undegraded":"2024-04-16T12:55:16.367245+0000","last_fullsized":"2024-04-16T12:55:16.367245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:05.855584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368504+0000","last_change":"2024-04-16T12:55:09.617673+0000","last_active":"2024-04-16T12:55:16.368504+0000","last_peered":"2024-04-16T12:55:16.368504+0000","last_clean":"2024-04-16T12:55:16.368504+0000","last_became_active":"2024-04-16T12:55:09.617168+0000","last_became_peered":"2024-04-16T12:55:09.617168+0000","last_unstale":"2024-04-16T12:55:16.368504+0000","last_undegraded":"2024-04-16T12:55:16.368504+0000","last_fullsized":"2024-04-16T12:55:16.368504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:18.474748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632028+0000","last_change":"2024-04-16T12:55:08.603386+0000","last_active":"2024-04-16T12:55:14.632028+0000","last_peered":"2024-04-16T12:55:14.632028+0000","last_clean":"2024-04-16T12:55:14.632028+0000","last_became_active":"2024-04-16T12:55:08.603101+0000","last_became_peered":"2024-04-16T12:55:08.603101+0000","last_unstale":"2024-04-16T12:55:14.632028+0000","last_undegraded":"2024-04-16T12:55:14.632028+0000","last_fullsized":"2024-04-16T12:55:14.632028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633245+0000","last_change":"2024-04-16T12:55:13.982430+0000","last_active":"2024-04-16T12:55:14.633245+0000","last_peered":"2024-04-16T12:55:14.633245+0000","last_clean":"2024-04-16T12:55:14.633245+0000","last_became_active":"2024-04-16T12:55:13.982015+0000","last_became_peered":"2024-04-16T12:55:13.982015+0000","last_unstale":"2024-04-16T12:55:14.633245+0000","last_undegraded":"2024-04-16T12:55:14.633245+0000","last_fullsized":"2024-04-16T12:55:14.633245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:40.569148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368249+0000","last_change":"2024-04-16T12:55:09.616105+0000","last_active":"2024-04-16T12:55:16.368249+0000","last_peered":"2024-04-16T12:55:16.368249+0000","last_clean":"2024-04-16T12:55:16.368249+0000","last_became_active":"2024-04-16T12:55:09.615832+0000","last_became_peered":"2024-04-16T12:55:09.615832+0000","last_unstale":"2024-04-16T12:55:16.368249+0000","last_undegraded":"2024-04-16T12:55:16.368249+0000","last_fullsized":"2024-04-16T12:55:16.368249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:34.194474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368416+0000","last_change":"2024-04-16T12:55:08.603695+0000","last_active":"2024-04-16T12:55:16.368416+0000","last_peered":"2024-04-16T12:55:16.368416+0000","last_clean":"2024-04-16T12:55:16.368416+0000","last_became_active":"2024-04-16T12:55:08.603425+0000","last_became_peered":"2024-04-16T12:55:08.603425+0000","last_unstale":"2024-04-16T12:55:16.368416+0000","last_undegraded":"2024-04-16T12:55:16.368416+0000","last_fullsized":"2024-04-16T12:55:16.368416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369160+0000","last_change":"2024-04-16T12:55:13.644589+0000","last_active":"2024-04-16T12:55:16.369160+0000","last_peered":"2024-04-16T12:55:16.369160+0000","last_clean":"2024-04-16T12:55:16.369160+0000","last_became_active":"2024-04-16T12:55:13.644211+0000","last_became_peered":"2024-04-16T12:55:13.644211+0000","last_unstale":"2024-04-16T12:55:16.369160+0000","last_undegraded":"2024-04-16T12:55:16.369160+0000","last_fullsized":"2024-04-16T12:55:16.369160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:50:38.226650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368542+0000","last_change":"2024-04-16T12:55:09.615275+0000","last_active":"2024-04-16T12:55:16.368542+0000","last_peered":"2024-04-16T12:55:16.368542+0000","last_clean":"2024-04-16T12:55:16.368542+0000","last_became_active":"2024-04-16T12:55:09.614772+0000","last_became_peered":"2024-04-16T12:55:09.614772+0000","last_unstale":"2024-04-16T12:55:16.368542+0000","last_undegraded":"2024-04-16T12:55:16.368542+0000","last_fullsized":"2024-04-16T12:55:16.368542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:26.344291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631386+0000","last_change":"2024-04-16T12:55:08.598164+0000","last_active":"2024-04-16T12:55:14.631386+0000","last_peered":"2024-04-16T12:55:14.631386+0000","last_clean":"2024-04-16T12:55:14.631386+0000","last_became_active":"2024-04-16T12:55:08.597846+0000","last_became_peered":"2024-04-16T12:55:08.597846+0000","last_unstale":"2024-04-16T12:55:14.631386+0000","last_undegraded":"2024-04-16T12:55:14.631386+0000","last_fullsized":"2024-04-16T12:55:14.631386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:27:00.498256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367265+0000","last_change":"2024-04-16T12:55:13.640511+0000","last_active":"2024-04-16T12:55:16.367265+0000","last_peered":"2024-04-16T12:55:16.367265+0000","last_clean":"2024-04-16T12:55:16.367265+0000","last_became_active":"2024-04-16T12:55:13.639882+0000","last_became_peered":"2024-04-16T12:55:13.639882+0000","last_unstale":"2024-04-16T12:55:16.367265+0000","last_undegraded":"2024-04-16T12:55:16.367265+0000","last_fullsized":"2024-04-16T12:55:16.367265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:16:22.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367597+0000","last_change":"2024-04-16T12:55:09.609001+0000","last_active":"2024-04-16T12:55:16.367597+0000","last_peered":"2024-04-16T12:55:16.367597+0000","last_clean":"2024-04-16T12:55:16.367597+0000","last_became_active":"2024-04-16T12:55:09.608734+0000","last_became_peered":"2024-04-16T12:55:09.608734+0000","last_unstale":"2024-04-16T12:55:16.367597+0000","last_undegraded":"2024-04-16T12:55:16.367597+0000","last_fullsized":"2024-04-16T12:55:16.367597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367952+0000","last_change":"2024-04-16T12:55:08.603335+0000","last_active":"2024-04-16T12:55:16.367952+0000","last_peered":"2024-04-16T12:55:16.367952+0000","last_clean":"2024-04-16T12:55:16.367952+0000","last_became_active":"2024-04-16T12:55:08.602990+0000","last_became_peered":"2024-04-16T12:55:08.602990+0000","last_unstale":"2024-04-16T12:55:16.367952+0000","last_undegraded":"2024-04-16T12:55:16.367952+0000","last_fullsized":"2024-04-16T12:55:16.367952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695518+0000","last_change":"2024-04-16T12:55:13.982306+0000","last_active":"2024-04-16T12:55:14.695518+0000","last_peered":"2024-04-16T12:55:14.695518+0000","last_clean":"2024-04-16T12:55:14.695518+0000","last_became_active":"2024-04-16T12:55:13.981930+0000","last_became_peered":"2024-04-16T12:55:13.981930+0000","last_unstale":"2024-04-16T12:55:14.695518+0000","last_undegraded":"2024-04-16T12:55:14.695518+0000","last_fullsized":"2024-04-16T12:55:14.695518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:08.880707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368720+0000","last_change":"2024-04-16T12:55:09.614600+0000","last_active":"2024-04-16T12:55:16.368720+0000","last_peered":"2024-04-16T12:55:16.368720+0000","last_clean":"2024-04-16T12:55:16.368720+0000","last_became_active":"2024-04-16T12:55:09.614325+0000","last_became_peered":"2024-04-16T12:55:09.614325+0000","last_unstale":"2024-04-16T12:55:16.368720+0000","last_undegraded":"2024-04-16T12:55:16.368720+0000","last_fullsized":"2024-04-16T12:55:16.368720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633785+0000","last_change":"2024-04-16T12:55:08.608010+0000","last_active":"2024-04-16T12:55:14.633785+0000","last_peered":"2024-04-16T12:55:14.633785+0000","last_clean":"2024-04-16T12:55:14.633785+0000","last_became_active":"2024-04-16T12:55:08.607694+0000","last_became_peered":"2024-04-16T12:55:08.607694+0000","last_unstale":"2024-04-16T12:55:14.633785+0000","last_undegraded":"2024-04-16T12:55:14.633785+0000","last_fullsized":"2024-04-16T12:55:14.633785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695213+0000","last_change":"2024-04-16T12:55:13.981780+0000","last_active":"2024-04-16T12:55:14.695213+0000","last_peered":"2024-04-16T12:55:14.695213+0000","last_clean":"2024-04-16T12:55:14.695213+0000","last_became_active":"2024-04-16T12:55:13.981378+0000","last_became_peered":"2024-04-16T12:55:13.981378+0000","last_unstale":"2024-04-16T12:55:14.695213+0000","last_undegraded":"2024-04-16T12:55:14.695213+0000","last_fullsized":"2024-04-16T12:55:14.695213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:34.588593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367107+0000","last_change":"2024-04-16T12:55:09.611318+0000","last_active":"2024-04-16T12:55:16.367107+0000","last_peered":"2024-04-16T12:55:16.367107+0000","last_clean":"2024-04-16T12:55:16.367107+0000","last_became_active":"2024-04-16T12:55:09.611021+0000","last_became_peered":"2024-04-16T12:55:09.611021+0000","last_unstale":"2024-04-16T12:55:16.367107+0000","last_undegraded":"2024-04-16T12:55:16.367107+0000","last_fullsized":"2024-04-16T12:55:16.367107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:24:22.528974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367349+0000","last_change":"2024-04-16T12:55:08.601634+0000","last_active":"2024-04-16T12:55:16.367349+0000","last_peered":"2024-04-16T12:55:16.367349+0000","last_clean":"2024-04-16T12:55:16.367349+0000","last_became_active":"2024-04-16T12:55:08.601348+0000","last_became_peered":"2024-04-16T12:55:08.601348+0000","last_unstale":"2024-04-16T12:55:16.367349+0000","last_undegraded":"2024-04-16T12:55:16.367349+0000","last_fullsized":"2024-04-16T12:55:16.367349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:39.045294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634061+0000","last_change":"2024-04-16T12:55:13.982101+0000","last_active":"2024-04-16T12:55:14.634061+0000","last_peered":"2024-04-16T12:55:14.634061+0000","last_clean":"2024-04-16T12:55:14.634061+0000","last_became_active":"2024-04-16T12:55:13.981652+0000","last_became_peered":"2024-04-16T12:55:13.981652+0000","last_unstale":"2024-04-16T12:55:14.634061+0000","last_undegraded":"2024-04-16T12:55:14.634061+0000","last_fullsized":"2024-04-16T12:55:14.634061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368372+0000","last_change":"2024-04-16T12:55:09.620820+0000","last_active":"2024-04-16T12:55:16.368372+0000","last_peered":"2024-04-16T12:55:16.368372+0000","last_clean":"2024-04-16T12:55:16.368372+0000","last_became_active":"2024-04-16T12:55:09.620534+0000","last_became_peered":"2024-04-16T12:55:09.620534+0000","last_unstale":"2024-04-16T12:55:16.368372+0000","last_undegraded":"2024-04-16T12:55:16.368372+0000","last_fullsized":"2024-04-16T12:55:16.368372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:19.234376+0000","last_change":"2024-04-16T12:55:08.605338+0000","last_active":"2024-04-16T12:55:19.234376+0000","last_peered":"2024-04-16T12:55:19.234376+0000","last_clean":"2024-04-16T12:55:19.234376+0000","last_became_active":"2024-04-16T12:55:08.604774+0000","last_became_peered":"2024-04-16T12:55:08.604774+0000","last_unstale":"2024-04-16T12:55:19.234376+0000","last_undegraded":"2024-04-16T12:55:19.234376+0000","last_fullsized":"2024-04-16T12:55:19.234376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633006+0000","last_change":"2024-04-16T12:55:13.646516+0000","last_active":"2024-04-16T12:55:14.633006+0000","last_peered":"2024-04-16T12:55:14.633006+0000","last_clean":"2024-04-16T12:55:14.633006+0000","last_became_active":"2024-04-16T12:55:13.645703+0000","last_became_peered":"2024-04-16T12:55:13.645703+0000","last_unstale":"2024-04-16T12:55:14.633006+0000","last_undegraded":"2024-04-16T12:55:14.633006+0000","last_fullsized":"2024-04-16T12:55:14.633006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369060+0000","last_change":"2024-04-16T12:55:09.606507+0000","last_active":"2024-04-16T12:55:16.369060+0000","last_peered":"2024-04-16T12:55:16.369060+0000","last_clean":"2024-04-16T12:55:16.369060+0000","last_became_active":"2024-04-16T12:55:09.606250+0000","last_became_peered":"2024-04-16T12:55:09.606250+0000","last_unstale":"2024-04-16T12:55:16.369060+0000","last_undegraded":"2024-04-16T12:55:16.369060+0000","last_fullsized":"2024-04-16T12:55:16.369060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633241+0000","last_change":"2024-04-16T12:55:08.609448+0000","last_active":"2024-04-16T12:55:14.633241+0000","last_peered":"2024-04-16T12:55:14.633241+0000","last_clean":"2024-04-16T12:55:14.633241+0000","last_became_active":"2024-04-16T12:55:08.609122+0000","last_became_peered":"2024-04-16T12:55:08.609122+0000","last_unstale":"2024-04-16T12:55:14.633241+0000","last_undegraded":"2024-04-16T12:55:14.633241+0000","last_fullsized":"2024-04-16T12:55:14.633241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:01.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369406+0000","last_change":"2024-04-16T12:55:13.644519+0000","last_active":"2024-04-16T12:55:16.369406+0000","last_peered":"2024-04-16T12:55:16.369406+0000","last_clean":"2024-04-16T12:55:16.369406+0000","last_became_active":"2024-04-16T12:55:13.644072+0000","last_became_peered":"2024-04-16T12:55:13.644072+0000","last_unstale":"2024-04-16T12:55:16.369406+0000","last_undegraded":"2024-04-16T12:55:16.369406+0000","last_fullsized":"2024-04-16T12:55:16.369406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:46:03.174610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367454+0000","last_change":"2024-04-16T12:55:09.599598+0000","last_active":"2024-04-16T12:55:16.367454+0000","last_peered":"2024-04-16T12:55:16.367454+0000","last_clean":"2024-04-16T12:55:16.367454+0000","last_became_active":"2024-04-16T12:55:09.599115+0000","last_became_peered":"2024-04-16T12:55:09.599115+0000","last_unstale":"2024-04-16T12:55:16.367454+0000","last_undegraded":"2024-04-16T12:55:16.367454+0000","last_fullsized":"2024-04-16T12:55:16.367454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633947+0000","last_change":"2024-04-16T12:55:08.607221+0000","last_active":"2024-04-16T12:55:14.633947+0000","last_peered":"2024-04-16T12:55:14.633947+0000","last_clean":"2024-04-16T12:55:14.633947+0000","last_became_active":"2024-04-16T12:55:08.606654+0000","last_became_peered":"2024-04-16T12:55:08.606654+0000","last_unstale":"2024-04-16T12:55:14.633947+0000","last_undegraded":"2024-04-16T12:55:14.633947+0000","last_fullsized":"2024-04-16T12:55:14.633947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:25.638178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694767+0000","last_change":"2024-04-16T12:55:13.638453+0000","last_active":"2024-04-16T12:55:14.694767+0000","last_peered":"2024-04-16T12:55:14.694767+0000","last_clean":"2024-04-16T12:55:14.694767+0000","last_became_active":"2024-04-16T12:55:13.637979+0000","last_became_peered":"2024-04-16T12:55:13.637979+0000","last_unstale":"2024-04-16T12:55:14.694767+0000","last_undegraded":"2024-04-16T12:55:14.694767+0000","last_fullsized":"2024-04-16T12:55:14.694767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:03:31.585691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633869+0000","last_change":"2024-04-16T12:55:09.608895+0000","last_active":"2024-04-16T12:55:14.633869+0000","last_peered":"2024-04-16T12:55:14.633869+0000","last_clean":"2024-04-16T12:55:14.633869+0000","last_became_active":"2024-04-16T12:55:09.608614+0000","last_became_peered":"2024-04-16T12:55:09.608614+0000","last_unstale":"2024-04-16T12:55:14.633869+0000","last_undegraded":"2024-04-16T12:55:14.633869+0000","last_fullsized":"2024-04-16T12:55:14.633869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369378+0000","last_change":"2024-04-16T12:55:08.609382+0000","last_active":"2024-04-16T12:55:16.369378+0000","last_peered":"2024-04-16T12:55:16.369378+0000","last_clean":"2024-04-16T12:55:16.369378+0000","last_became_active":"2024-04-16T12:55:08.609119+0000","last_became_peered":"2024-04-16T12:55:08.609119+0000","last_unstale":"2024-04-16T12:55:16.369378+0000","last_undegraded":"2024-04-16T12:55:16.369378+0000","last_fullsized":"2024-04-16T12:55:16.369378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:20.083861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694727+0000","last_change":"2024-04-16T12:55:13.983697+0000","last_active":"2024-04-16T12:55:14.694727+0000","last_peered":"2024-04-16T12:55:14.694727+0000","last_clean":"2024-04-16T12:55:14.694727+0000","last_became_active":"2024-04-16T12:55:13.983341+0000","last_became_peered":"2024-04-16T12:55:13.983341+0000","last_unstale":"2024-04-16T12:55:14.694727+0000","last_undegraded":"2024-04-16T12:55:14.694727+0000","last_fullsized":"2024-04-16T12:55:14.694727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:42.607366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367175+0000","last_change":"2024-04-16T12:55:13.982783+0000","last_active":"2024-04-16T12:55:16.367175+0000","last_peered":"2024-04-16T12:55:16.367175+0000","last_clean":"2024-04-16T12:55:16.367175+0000","last_became_active":"2024-04-16T12:55:13.982410+0000","last_became_peered":"2024-04-16T12:55:13.982410+0000","last_unstale":"2024-04-16T12:55:16.367175+0000","last_undegraded":"2024-04-16T12:55:16.367175+0000","last_fullsized":"2024-04-16T12:55:16.367175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:47.102507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632676+0000","last_change":"2024-04-16T12:55:09.613731+0000","last_active":"2024-04-16T12:55:14.632676+0000","last_peered":"2024-04-16T12:55:14.632676+0000","last_clean":"2024-04-16T12:55:14.632676+0000","last_became_active":"2024-04-16T12:55:09.613019+0000","last_became_peered":"2024-04-16T12:55:09.613019+0000","last_unstale":"2024-04-16T12:55:14.632676+0000","last_undegraded":"2024-04-16T12:55:14.632676+0000","last_fullsized":"2024-04-16T12:55:14.632676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633344+0000","last_change":"2024-04-16T12:55:08.607825+0000","last_active":"2024-04-16T12:55:14.633344+0000","last_peered":"2024-04-16T12:55:14.633344+0000","last_clean":"2024-04-16T12:55:14.633344+0000","last_became_active":"2024-04-16T12:55:08.607513+0000","last_became_peered":"2024-04-16T12:55:08.607513+0000","last_unstale":"2024-04-16T12:55:14.633344+0000","last_undegraded":"2024-04-16T12:55:14.633344+0000","last_fullsized":"2024-04-16T12:55:14.633344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369166+0000","last_change":"2024-04-16T12:55:13.648936+0000","last_active":"2024-04-16T12:55:16.369166+0000","last_peered":"2024-04-16T12:55:16.369166+0000","last_clean":"2024-04-16T12:55:16.369166+0000","last_became_active":"2024-04-16T12:55:13.648492+0000","last_became_peered":"2024-04-16T12:55:13.648492+0000","last_unstale":"2024-04-16T12:55:16.369166+0000","last_undegraded":"2024-04-16T12:55:16.369166+0000","last_fullsized":"2024-04-16T12:55:16.369166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:20.105354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694761+0000","last_change":"2024-04-16T12:55:09.613188+0000","last_active":"2024-04-16T12:55:14.694761+0000","last_peered":"2024-04-16T12:55:14.694761+0000","last_clean":"2024-04-16T12:55:14.694761+0000","last_became_active":"2024-04-16T12:55:09.612860+0000","last_became_peered":"2024-04-16T12:55:09.612860+0000","last_unstale":"2024-04-16T12:55:14.694761+0000","last_undegraded":"2024-04-16T12:55:14.694761+0000","last_fullsized":"2024-04-16T12:55:14.694761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694941+0000","last_change":"2024-04-16T12:55:08.603901+0000","last_active":"2024-04-16T12:55:14.694941+0000","last_peered":"2024-04-16T12:55:14.694941+0000","last_clean":"2024-04-16T12:55:14.694941+0000","last_became_active":"2024-04-16T12:55:08.603600+0000","last_became_peered":"2024-04-16T12:55:08.603600+0000","last_unstale":"2024-04-16T12:55:14.694941+0000","last_undegraded":"2024-04-16T12:55:14.694941+0000","last_fullsized":"2024-04-16T12:55:14.694941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:10.256947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368157+0000","last_change":"2024-04-16T12:55:08.603403+0000","last_active":"2024-04-16T12:55:16.368157+0000","last_peered":"2024-04-16T12:55:16.368157+0000","last_clean":"2024-04-16T12:55:16.368157+0000","last_became_active":"2024-04-16T12:55:08.603126+0000","last_became_peered":"2024-04-16T12:55:08.603126+0000","last_unstale":"2024-04-16T12:55:16.368157+0000","last_undegraded":"2024-04-16T12:55:16.368157+0000","last_fullsized":"2024-04-16T12:55:16.368157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:42.695217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367337+0000","last_change":"2024-04-16T12:55:09.599833+0000","last_active":"2024-04-16T12:55:16.367337+0000","last_peered":"2024-04-16T12:55:16.367337+0000","last_clean":"2024-04-16T12:55:16.367337+0000","last_became_active":"2024-04-16T12:55:09.599149+0000","last_became_peered":"2024-04-16T12:55:09.599149+0000","last_unstale":"2024-04-16T12:55:16.367337+0000","last_undegraded":"2024-04-16T12:55:16.367337+0000","last_fullsized":"2024-04-16T12:55:16.367337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631664+0000","last_change":"2024-04-16T12:55:13.650199+0000","last_active":"2024-04-16T12:55:14.631664+0000","last_peered":"2024-04-16T12:55:14.631664+0000","last_clean":"2024-04-16T12:55:14.631664+0000","last_became_active":"2024-04-16T12:55:13.649637+0000","last_became_peered":"2024-04-16T12:55:13.649637+0000","last_unstale":"2024-04-16T12:55:14.631664+0000","last_undegraded":"2024-04-16T12:55:14.631664+0000","last_fullsized":"2024-04-16T12:55:14.631664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:31.305753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694949+0000","last_change":"2024-04-16T12:55:08.606921+0000","last_active":"2024-04-16T12:55:14.694949+0000","last_peered":"2024-04-16T12:55:14.694949+0000","last_clean":"2024-04-16T12:55:14.694949+0000","last_became_active":"2024-04-16T12:55:08.606543+0000","last_became_peered":"2024-04-16T12:55:08.606543+0000","last_unstale":"2024-04-16T12:55:14.694949+0000","last_undegraded":"2024-04-16T12:55:14.694949+0000","last_fullsized":"2024-04-16T12:55:14.694949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:07.575954+0000","last_clean_scrub_stamp":"2024-04-16T12:55:07.575954+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:50.572924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367882+0000","last_change":"2024-04-16T12:55:09.607307+0000","last_active":"2024-04-16T12:55:16.367882+0000","last_peered":"2024-04-16T12:55:16.367882+0000","last_clean":"2024-04-16T12:55:16.367882+0000","last_became_active":"2024-04-16T12:55:09.607019+0000","last_became_peered":"2024-04-16T12:55:09.607019+0000","last_unstale":"2024-04-16T12:55:16.367882+0000","last_undegraded":"2024-04-16T12:55:16.367882+0000","last_fullsized":"2024-04-16T12:55:16.367882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:21:02.600497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695264+0000","last_change":"2024-04-16T12:55:13.641212+0000","last_active":"2024-04-16T12:55:14.695264+0000","last_peered":"2024-04-16T12:55:14.695264+0000","last_clean":"2024-04-16T12:55:14.695264+0000","last_became_active":"2024-04-16T12:55:13.640805+0000","last_became_peered":"2024-04-16T12:55:13.640805+0000","last_unstale":"2024-04-16T12:55:14.695264+0000","last_undegraded":"2024-04-16T12:55:14.695264+0000","last_fullsized":"2024-04-16T12:55:14.695264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:12.613208+0000","last_clean_scrub_stamp":"2024-04-16T12:55:12.613208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:17.726629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367396+0000","last_change":"2024-04-16T12:55:09.609579+0000","last_active":"2024-04-16T12:55:16.367396+0000","last_peered":"2024-04-16T12:55:16.367396+0000","last_clean":"2024-04-16T12:55:16.367396+0000","last_became_active":"2024-04-16T12:55:09.609318+0000","last_became_peered":"2024-04-16T12:55:09.609318+0000","last_unstale":"2024-04-16T12:55:16.367396+0000","last_undegraded":"2024-04-16T12:55:16.367396+0000","last_fullsized":"2024-04-16T12:55:16.367396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.631556+0000","last_change":"2024-04-16T12:55:09.603666+0000","last_active":"2024-04-16T12:55:14.631556+0000","last_peered":"2024-04-16T12:55:14.631556+0000","last_clean":"2024-04-16T12:55:14.631556+0000","last_became_active":"2024-04-16T12:55:09.603143+0000","last_became_peered":"2024-04-16T12:55:09.603143+0000","last_unstale":"2024-04-16T12:55:14.631556+0000","last_undegraded":"2024-04-16T12:55:14.631556+0000","last_fullsized":"2024-04-16T12:55:14.631556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633935+0000","last_change":"2024-04-16T12:55:09.617882+0000","last_active":"2024-04-16T12:55:14.633935+0000","last_peered":"2024-04-16T12:55:14.633935+0000","last_clean":"2024-04-16T12:55:14.633935+0000","last_became_active":"2024-04-16T12:55:09.616769+0000","last_became_peered":"2024-04-16T12:55:09.616769+0000","last_unstale":"2024-04-16T12:55:14.633935+0000","last_undegraded":"2024-04-16T12:55:14.633935+0000","last_fullsized":"2024-04-16T12:55:14.633935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:38:16.073178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367223+0000","last_change":"2024-04-16T12:55:09.602044+0000","last_active":"2024-04-16T12:55:16.367223+0000","last_peered":"2024-04-16T12:55:16.367223+0000","last_clean":"2024-04-16T12:55:16.367223+0000","last_became_active":"2024-04-16T12:55:09.601747+0000","last_became_peered":"2024-04-16T12:55:09.601747+0000","last_unstale":"2024-04-16T12:55:16.367223+0000","last_undegraded":"2024-04-16T12:55:16.367223+0000","last_fullsized":"2024-04-16T12:55:16.367223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695371+0000","last_change":"2024-04-16T12:55:09.600028+0000","last_active":"2024-04-16T12:55:14.695371+0000","last_peered":"2024-04-16T12:55:14.695371+0000","last_clean":"2024-04-16T12:55:14.695371+0000","last_became_active":"2024-04-16T12:55:09.599747+0000","last_became_peered":"2024-04-16T12:55:09.599747+0000","last_unstale":"2024-04-16T12:55:14.695371+0000","last_undegraded":"2024-04-16T12:55:14.695371+0000","last_fullsized":"2024-04-16T12:55:14.695371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:19.584390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633104+0000","last_change":"2024-04-16T12:55:09.612581+0000","last_active":"2024-04-16T12:55:14.633104+0000","last_peered":"2024-04-16T12:55:14.633104+0000","last_clean":"2024-04-16T12:55:14.633104+0000","last_became_active":"2024-04-16T12:55:09.612244+0000","last_became_peered":"2024-04-16T12:55:09.612244+0000","last_unstale":"2024-04-16T12:55:14.633104+0000","last_undegraded":"2024-04-16T12:55:14.633104+0000","last_fullsized":"2024-04-16T12:55:14.633104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369155+0000","last_change":"2024-04-16T12:55:09.611077+0000","last_active":"2024-04-16T12:55:16.369155+0000","last_peered":"2024-04-16T12:55:16.369155+0000","last_clean":"2024-04-16T12:55:16.369155+0000","last_became_active":"2024-04-16T12:55:09.610542+0000","last_became_peered":"2024-04-16T12:55:09.610542+0000","last_unstale":"2024-04-16T12:55:16.369155+0000","last_undegraded":"2024-04-16T12:55:16.369155+0000","last_fullsized":"2024-04-16T12:55:16.369155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.695447+0000","last_change":"2024-04-16T12:55:09.600725+0000","last_active":"2024-04-16T12:55:14.695447+0000","last_peered":"2024-04-16T12:55:14.695447+0000","last_clean":"2024-04-16T12:55:14.695447+0000","last_became_active":"2024-04-16T12:55:09.600418+0000","last_became_peered":"2024-04-16T12:55:09.600418+0000","last_unstale":"2024-04-16T12:55:14.695447+0000","last_undegraded":"2024-04-16T12:55:14.695447+0000","last_fullsized":"2024-04-16T12:55:14.695447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:14.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633340+0000","last_change":"2024-04-16T12:55:09.616346+0000","last_active":"2024-04-16T12:55:14.633340+0000","last_peered":"2024-04-16T12:55:14.633340+0000","last_clean":"2024-04-16T12:55:14.633340+0000","last_became_active":"2024-04-16T12:55:09.615328+0000","last_became_peered":"2024-04-16T12:55:09.615328+0000","last_unstale":"2024-04-16T12:55:14.633340+0000","last_undegraded":"2024-04-16T12:55:14.633340+0000","last_fullsized":"2024-04-16T12:55:14.633340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694859+0000","last_change":"2024-04-16T12:55:09.597852+0000","last_active":"2024-04-16T12:55:14.694859+0000","last_peered":"2024-04-16T12:55:14.694859+0000","last_clean":"2024-04-16T12:55:14.694859+0000","last_became_active":"2024-04-16T12:55:09.597466+0000","last_became_peered":"2024-04-16T12:55:09.597466+0000","last_unstale":"2024-04-16T12:55:14.694859+0000","last_undegraded":"2024-04-16T12:55:14.694859+0000","last_fullsized":"2024-04-16T12:55:14.694859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633627+0000","last_change":"2024-04-16T12:55:09.610381+0000","last_active":"2024-04-16T12:55:14.633627+0000","last_peered":"2024-04-16T12:55:14.633627+0000","last_clean":"2024-04-16T12:55:14.633627+0000","last_became_active":"2024-04-16T12:55:09.610124+0000","last_became_peered":"2024-04-16T12:55:09.610124+0000","last_unstale":"2024-04-16T12:55:14.633627+0000","last_undegraded":"2024-04-16T12:55:14.633627+0000","last_fullsized":"2024-04-16T12:55:14.633627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:45:59.142434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367062+0000","last_change":"2024-04-16T12:55:09.616215+0000","last_active":"2024-04-16T12:55:16.367062+0000","last_peered":"2024-04-16T12:55:16.367062+0000","last_clean":"2024-04-16T12:55:16.367062+0000","last_became_active":"2024-04-16T12:55:09.615568+0000","last_became_peered":"2024-04-16T12:55:09.615568+0000","last_unstale":"2024-04-16T12:55:16.367062+0000","last_undegraded":"2024-04-16T12:55:16.367062+0000","last_fullsized":"2024-04-16T12:55:16.367062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369286+0000","last_change":"2024-04-16T12:55:09.617828+0000","last_active":"2024-04-16T12:55:16.369286+0000","last_peered":"2024-04-16T12:55:16.369286+0000","last_clean":"2024-04-16T12:55:16.369286+0000","last_became_active":"2024-04-16T12:55:09.617544+0000","last_became_peered":"2024-04-16T12:55:09.617544+0000","last_unstale":"2024-04-16T12:55:16.369286+0000","last_undegraded":"2024-04-16T12:55:16.369286+0000","last_fullsized":"2024-04-16T12:55:16.369286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:58.653479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368942+0000","last_change":"2024-04-16T12:55:09.612315+0000","last_active":"2024-04-16T12:55:16.368942+0000","last_peered":"2024-04-16T12:55:16.368942+0000","last_clean":"2024-04-16T12:55:16.368942+0000","last_became_active":"2024-04-16T12:55:09.612023+0000","last_became_peered":"2024-04-16T12:55:09.612023+0000","last_unstale":"2024-04-16T12:55:16.368942+0000","last_undegraded":"2024-04-16T12:55:16.368942+0000","last_fullsized":"2024-04-16T12:55:16.368942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:26.067302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632023+0000","last_change":"2024-04-16T12:55:09.609432+0000","last_active":"2024-04-16T12:55:14.632023+0000","last_peered":"2024-04-16T12:55:14.632023+0000","last_clean":"2024-04-16T12:55:14.632023+0000","last_became_active":"2024-04-16T12:55:09.609172+0000","last_became_peered":"2024-04-16T12:55:09.609172+0000","last_unstale":"2024-04-16T12:55:14.632023+0000","last_undegraded":"2024-04-16T12:55:14.632023+0000","last_fullsized":"2024-04-16T12:55:14.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:30.712811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.634287+0000","last_change":"2024-04-16T12:55:09.607797+0000","last_active":"2024-04-16T12:55:14.634287+0000","last_peered":"2024-04-16T12:55:14.634287+0000","last_clean":"2024-04-16T12:55:14.634287+0000","last_became_active":"2024-04-16T12:55:09.607546+0000","last_became_peered":"2024-04-16T12:55:09.607546+0000","last_unstale":"2024-04-16T12:55:14.634287+0000","last_undegraded":"2024-04-16T12:55:14.634287+0000","last_fullsized":"2024-04-16T12:55:14.634287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:11.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633202+0000","last_change":"2024-04-16T12:55:09.613594+0000","last_active":"2024-04-16T12:55:14.633202+0000","last_peered":"2024-04-16T12:55:14.633202+0000","last_clean":"2024-04-16T12:55:14.633202+0000","last_became_active":"2024-04-16T12:55:09.613296+0000","last_became_peered":"2024-04-16T12:55:09.613296+0000","last_unstale":"2024-04-16T12:55:14.633202+0000","last_undegraded":"2024-04-16T12:55:14.633202+0000","last_fullsized":"2024-04-16T12:55:14.633202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.632804+0000","last_change":"2024-04-16T12:55:09.613823+0000","last_active":"2024-04-16T12:55:14.632804+0000","last_peered":"2024-04-16T12:55:14.632804+0000","last_clean":"2024-04-16T12:55:14.632804+0000","last_became_active":"2024-04-16T12:55:09.613460+0000","last_became_peered":"2024-04-16T12:55:09.613460+0000","last_unstale":"2024-04-16T12:55:14.632804+0000","last_undegraded":"2024-04-16T12:55:14.632804+0000","last_fullsized":"2024-04-16T12:55:14.632804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:06:19.748987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367104+0000","last_change":"2024-04-16T12:55:09.605119+0000","last_active":"2024-04-16T12:55:16.367104+0000","last_peered":"2024-04-16T12:55:16.367104+0000","last_clean":"2024-04-16T12:55:16.367104+0000","last_became_active":"2024-04-16T12:55:09.604862+0000","last_became_peered":"2024-04-16T12:55:09.604862+0000","last_unstale":"2024-04-16T12:55:16.367104+0000","last_undegraded":"2024-04-16T12:55:16.367104+0000","last_fullsized":"2024-04-16T12:55:16.367104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:20:09.316326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694754+0000","last_change":"2024-04-16T12:55:09.605111+0000","last_active":"2024-04-16T12:55:14.694754+0000","last_peered":"2024-04-16T12:55:14.694754+0000","last_clean":"2024-04-16T12:55:14.694754+0000","last_became_active":"2024-04-16T12:55:09.604719+0000","last_became_peered":"2024-04-16T12:55:09.604719+0000","last_unstale":"2024-04-16T12:55:14.694754+0000","last_undegraded":"2024-04-16T12:55:14.694754+0000","last_fullsized":"2024-04-16T12:55:14.694754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:03.249168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368708+0000","last_change":"2024-04-16T12:55:09.608920+0000","last_active":"2024-04-16T12:55:16.368708+0000","last_peered":"2024-04-16T12:55:16.368708+0000","last_clean":"2024-04-16T12:55:16.368708+0000","last_became_active":"2024-04-16T12:55:09.608627+0000","last_became_peered":"2024-04-16T12:55:09.608627+0000","last_unstale":"2024-04-16T12:55:16.368708+0000","last_undegraded":"2024-04-16T12:55:16.368708+0000","last_fullsized":"2024-04-16T12:55:16.368708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:27:45.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369071+0000","last_change":"2024-04-16T12:55:09.619322+0000","last_active":"2024-04-16T12:55:16.369071+0000","last_peered":"2024-04-16T12:55:16.369071+0000","last_clean":"2024-04-16T12:55:16.369071+0000","last_became_active":"2024-04-16T12:55:09.619043+0000","last_became_peered":"2024-04-16T12:55:09.619043+0000","last_unstale":"2024-04-16T12:55:16.369071+0000","last_undegraded":"2024-04-16T12:55:16.369071+0000","last_fullsized":"2024-04-16T12:55:16.369071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:16.330278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.369041+0000","last_change":"2024-04-16T12:55:09.618675+0000","last_active":"2024-04-16T12:55:16.369041+0000","last_peered":"2024-04-16T12:55:16.369041+0000","last_clean":"2024-04-16T12:55:16.369041+0000","last_became_active":"2024-04-16T12:55:09.618346+0000","last_became_peered":"2024-04-16T12:55:09.618346+0000","last_unstale":"2024-04-16T12:55:16.369041+0000","last_undegraded":"2024-04-16T12:55:16.369041+0000","last_fullsized":"2024-04-16T12:55:16.369041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368488+0000","last_change":"2024-04-16T12:55:09.616435+0000","last_active":"2024-04-16T12:55:16.368488+0000","last_peered":"2024-04-16T12:55:16.368488+0000","last_clean":"2024-04-16T12:55:16.368488+0000","last_became_active":"2024-04-16T12:55:09.616054+0000","last_became_peered":"2024-04-16T12:55:09.616054+0000","last_unstale":"2024-04-16T12:55:16.368488+0000","last_undegraded":"2024-04-16T12:55:16.368488+0000","last_fullsized":"2024-04-16T12:55:16.368488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:43.070331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.694651+0000","last_change":"2024-04-16T12:55:09.616193+0000","last_active":"2024-04-16T12:55:14.694651+0000","last_peered":"2024-04-16T12:55:14.694651+0000","last_clean":"2024-04-16T12:55:14.694651+0000","last_became_active":"2024-04-16T12:55:09.615114+0000","last_became_peered":"2024-04-16T12:55:09.615114+0000","last_unstale":"2024-04-16T12:55:14.694651+0000","last_undegraded":"2024-04-16T12:55:14.694651+0000","last_fullsized":"2024-04-16T12:55:14.694651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368221+0000","last_change":"2024-04-16T12:55:09.612626+0000","last_active":"2024-04-16T12:55:16.368221+0000","last_peered":"2024-04-16T12:55:16.368221+0000","last_clean":"2024-04-16T12:55:16.368221+0000","last_became_active":"2024-04-16T12:55:09.612338+0000","last_became_peered":"2024-04-16T12:55:09.612338+0000","last_unstale":"2024-04-16T12:55:16.368221+0000","last_undegraded":"2024-04-16T12:55:16.368221+0000","last_fullsized":"2024-04-16T12:55:16.368221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:55:42.238613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633547+0000","last_change":"2024-04-16T12:55:09.613314+0000","last_active":"2024-04-16T12:55:14.633547+0000","last_peered":"2024-04-16T12:55:14.633547+0000","last_clean":"2024-04-16T12:55:14.633547+0000","last_became_active":"2024-04-16T12:55:09.613047+0000","last_became_peered":"2024-04-16T12:55:09.613047+0000","last_unstale":"2024-04-16T12:55:14.633547+0000","last_undegraded":"2024-04-16T12:55:14.633547+0000","last_fullsized":"2024-04-16T12:55:14.633547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368254+0000","last_change":"2024-04-16T12:55:09.612821+0000","last_active":"2024-04-16T12:55:16.368254+0000","last_peered":"2024-04-16T12:55:16.368254+0000","last_clean":"2024-04-16T12:55:16.368254+0000","last_became_active":"2024-04-16T12:55:09.612537+0000","last_became_peered":"2024-04-16T12:55:09.612537+0000","last_unstale":"2024-04-16T12:55:16.368254+0000","last_undegraded":"2024-04-16T12:55:16.368254+0000","last_fullsized":"2024-04-16T12:55:16.368254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:39:08.742243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633793+0000","last_change":"2024-04-16T12:55:09.616023+0000","last_active":"2024-04-16T12:55:14.633793+0000","last_peered":"2024-04-16T12:55:14.633793+0000","last_clean":"2024-04-16T12:55:14.633793+0000","last_became_active":"2024-04-16T12:55:09.615631+0000","last_became_peered":"2024-04-16T12:55:09.615631+0000","last_unstale":"2024-04-16T12:55:14.633793+0000","last_undegraded":"2024-04-16T12:55:14.633793+0000","last_fullsized":"2024-04-16T12:55:14.633793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:49:45.162691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.367139+0000","last_change":"2024-04-16T12:55:09.595574+0000","last_active":"2024-04-16T12:55:16.367139+0000","last_peered":"2024-04-16T12:55:16.367139+0000","last_clean":"2024-04-16T12:55:16.367139+0000","last_became_active":"2024-04-16T12:55:09.595237+0000","last_became_peered":"2024-04-16T12:55:09.595237+0000","last_unstale":"2024-04-16T12:55:16.367139+0000","last_undegraded":"2024-04-16T12:55:16.367139+0000","last_fullsized":"2024-04-16T12:55:16.367139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:10:27.273577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:14.633687+0000","last_change":"2024-04-16T12:55:09.609132+0000","last_active":"2024-04-16T12:55:14.633687+0000","last_peered":"2024-04-16T12:55:14.633687+0000","last_clean":"2024-04-16T12:55:14.633687+0000","last_became_active":"2024-04-16T12:55:09.608733+0000","last_became_peered":"2024-04-16T12:55:09.608733+0000","last_unstale":"2024-04-16T12:55:14.633687+0000","last_undegraded":"2024-04-16T12:55:14.633687+0000","last_fullsized":"2024-04-16T12:55:14.633687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:12.708151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-16T12:55:16.368365+0000","last_change":"2024-04-16T12:55:09.617426+0000","last_active":"2024-04-16T12:55:16.368365+0000","last_peered":"2024-04-16T12:55:16.368365+0000","last_clean":"2024-04-16T12:55:16.368365+0000","last_became_active":"2024-04-16T12:55:09.616828+0000","last_became_peered":"2024-04-16T12:55:09.616828+0000","last_unstale":"2024-04-16T12:55:16.368365+0000","last_undegraded":"2024-04-16T12:55:16.368365+0000","last_fullsized":"2024-04-16T12:55:16.368365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:55:08.581032+0000","last_clean_scrub_stamp":"2024-04-16T12:55:08.581032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:01.823408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":690366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":262144,"data_stored":103258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":99416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":690422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:55:35.896 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T12:55:35.896 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T12:55:35.896 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T12:55:35.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T12:55:36.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.032+0000 7f9168be1640 1 Processor -- start 2024-04-16T12:55:36.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.032+0000 7f9168be1640 1 -- start start 2024-04-16T12:55:36.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f916415eca0 0x7f916406c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91640b37e0 0x7f91640d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640d4370 0x7f916406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f916415f080 con 0x7f916415eca0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f91640d2d90 con 0x7f91640b37e0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9168be1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f91640d3070 con 0x7f91640d4370 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f916415eca0 0x7f916406c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f916415eca0 0x7f916406c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39112/0 (socket says 172.21.15.18:39112) 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 -- 172.21.15.18:0/1188100149 learned_addr learned my addr 172.21.15.18:0/1188100149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9162d9d640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640d4370 0x7f916406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f9161d9b640 1 --2- 172.21.15.18:0/1188100149 >> v2:172.21.15.104:3300/0 conn(0x7f91640b37e0 0x7f91640d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 -- 172.21.15.18:0/1188100149 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640d4370 msgr2=0x7f916406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640d4370 0x7f916406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 -- 172.21.15.18:0/1188100149 >> v2:172.21.15.104:3300/0 conn(0x7f91640b37e0 msgr2=0x7f91640d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 --2- 172.21.15.18:0/1188100149 >> v2:172.21.15.104:3300/0 conn(0x7f91640b37e0 0x7f91640d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.033+0000 7f916259c640 1 -- 172.21.15.18:0/1188100149 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91640d3350 con 0x7f916415eca0 2024-04-16T12:55:36.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.034+0000 7f916259c640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f916415eca0 0x7f916406c430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9164069180 tx=0x7f915402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9847b41bb5e6cbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.034+0000 7f916159a640 1 -- 172.21.15.18:0/1188100149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154034070 con 0x7f916415eca0 2024-04-16T12:55:36.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.034+0000 7f916159a640 1 -- 172.21.15.18:0/1188100149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154030860 con 0x7f916415eca0 2024-04-16T12:55:36.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.034+0000 7f916159a640 1 -- 172.21.15.18:0/1188100149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154030c30 con 0x7f916415eca0 2024-04-16T12:55:36.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 -- 172.21.15.18:0/1188100149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f916415eca0 msgr2=0x7f916406c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f916415eca0 0x7f916406c430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9164069180 tx=0x7f915402b9a0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 -- 172.21.15.18:0/1188100149 shutdown_connections 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 --2- 172.21.15.18:0/1188100149 >> v2:172.21.15.104:3300/0 conn(0x7f91640b37e0 0x7f91640d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640d4370 0x7f916406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 --2- 172.21.15.18:0/1188100149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f916415eca0 0x7f916406c430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 -- 172.21.15.18:0/1188100149 >> 172.21.15.18:0/1188100149 conn(0x7f91640d48b0 msgr2=0x7f91640d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 -- 172.21.15.18:0/1188100149 shutdown_connections 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.035+0000 7f9168be1640 1 -- 172.21.15.18:0/1188100149 wait complete. 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.036+0000 7f9168be1640 1 Processor -- start 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.036+0000 7f9168be1640 1 -- start start 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 0x7f9164155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 0x7f9164161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f916406c970 con 0x7f91640d4370 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f91640d3910 con 0x7f916415eca0 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9168be1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f916406d350 con 0x7f91640b37e0 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39114/0 (socket says 172.21.15.18:39114) 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 -- 172.21.15.18:0/2805982618 learned_addr learned my addr 172.21.15.18:0/2805982618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f916259c640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 0x7f9164155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9162d9d640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 0x7f9164161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 -- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 msgr2=0x7f9164155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 0x7f9164155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 -- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 msgr2=0x7f9164161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 0x7f9164161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9161d9b640 1 -- 172.21.15.18:0/2805982618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9164160460 con 0x7f91640d4370 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f916259c640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 0x7f9164155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.037+0000 7f9162d9d640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 0x7f9164161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9161d9b640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f915800d800 tx=0x7f915800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158018020 con 0x7f91640d4370 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91580096a0 con 0x7f91640d4370 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9164160740 con 0x7f91640d4370 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158009a70 con 0x7f91640d4370 2024-04-16T12:55:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.038+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9164160d00 con 0x7f91640d4370 2024-04-16T12:55:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.039+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91640752b0 con 0x7f91640d4370 2024-04-16T12:55:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.039+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f915801b020 con 0x7f91640d4370 2024-04-16T12:55:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.040+0000 7f9152ffd640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 0x7f914406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.040+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f915808c040 con 0x7f91640d4370 2024-04-16T12:55:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.040+0000 7f916259c640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 0x7f914406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.040+0000 7f916259c640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 0x7f914406ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9154036000 tx=0x7f915403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.044+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9158022030 con 0x7f91640d4370 2024-04-16T12:55:36.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.269+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f91640b3d60 con 0x7f91640d4370 2024-04-16T12:55:36.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.269+0000 7f9152ffd640 1 -- 172.21.15.18:0/2805982618 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f915805a1c0 con 0x7f91640d4370 2024-04-16T12:55:36.271 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:36.271 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 msgr2=0x7f914406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 0x7f914406ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9154036000 tx=0x7f915403b040 comp rx=0 tx=0).stop 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 msgr2=0x7f91640cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f915800d800 tx=0x7f915800dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 shutdown_connections 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f914406c920 0x7f914406ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f916415eca0 0x7f9164161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91640d4370 0x7f91640cb980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 --2- 172.21.15.18:0/2805982618 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f91640b37e0 0x7f9164155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 >> 172.21.15.18:0/2805982618 conn(0x7f91640d48b0 msgr2=0x7f91640b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 shutdown_connections 2024-04-16T12:55:36.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.271+0000 7f9168be1640 1 -- 172.21.15.18:0/2805982618 wait complete. 2024-04-16T12:55:36.284 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T12:55:36.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.387+0000 7eff7b4e4640 1 Processor -- start 2024-04-16T12:55:36.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.387+0000 7eff7b4e4640 1 -- start start 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff7b4e4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740b37e0 0x7eff740d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff7b4e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7eff740d4370 0x7eff7406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff7b4e4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff740d2d90 con 0x7eff7415eca0 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff7b4e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7eff7415f080 con 0x7eff740d4370 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff7b4e4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7eff740d3070 con 0x7eff740b37e0 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7eff740d4370 0x7eff7406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7eff740d4370 0x7eff7406ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39124/0 (socket says 172.21.15.18:39124) 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 -- 172.21.15.18:0/3366480629 learned_addr learned my addr 172.21.15.18:0/3366480629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff78a7f640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740b37e0 0x7eff740d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 -- 172.21.15.18:0/3366480629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740b37e0 msgr2=0x7eff740d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:36.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740b37e0 0x7eff740d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 -- 172.21.15.18:0/3366480629 >> v1:172.21.15.104:6789/0 conn(0x7eff7415eca0 legacy=0x7eff7406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.388+0000 7eff79a81640 1 -- 172.21.15.18:0/3366480629 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff740d3350 con 0x7eff740d4370 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.389+0000 7eff79a81640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740d4370 0x7eff7406ce10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009870 tx=0x7eff6c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c86f4050de3222 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.389+0000 7eff73fff640 1 -- 172.21.15.18:0/3366480629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c02f840 con 0x7eff740d4370 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.389+0000 7eff73fff640 1 -- 172.21.15.18:0/3366480629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c02f9e0 con 0x7eff740d4370 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.389+0000 7eff73fff640 1 -- 172.21.15.18:0/3366480629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c02fdb0 con 0x7eff740d4370 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 -- 172.21.15.18:0/3366480629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740d4370 msgr2=0x7eff7406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740d4370 0x7eff7406ce10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009870 tx=0x7eff6c02ba20 comp rx=0 tx=0).stop 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 -- 172.21.15.18:0/3366480629 shutdown_connections 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740d4370 0x7eff7406ce10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/3366480629 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740b37e0 0x7eff740d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 -- 172.21.15.18:0/3366480629 >> 172.21.15.18:0/3366480629 conn(0x7eff740d48b0 msgr2=0x7eff740d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 -- 172.21.15.18:0/3366480629 shutdown_connections 2024-04-16T12:55:36.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.390+0000 7eff7b4e4640 1 -- 172.21.15.18:0/3366480629 wait complete. 2024-04-16T12:55:36.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.391+0000 7eff7b4e4640 1 Processor -- start 2024-04-16T12:55:36.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.391+0000 7eff7b4e4640 1 -- start start 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740d4370 0x7eff74161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff7415eca0 0x7eff740ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7eff7406d350 con 0x7eff740b37e0 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7eff740d3910 con 0x7eff7415eca0 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff7b4e4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7eff7406d4d0 con 0x7eff740d4370 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39132/0 (socket says 172.21.15.18:39132) 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 -- 172.21.15.18:0/583297918 learned_addr learned my addr 172.21.15.18:0/583297918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff78a7f640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740d4370 0x7eff74161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79a81640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff7415eca0 0x7eff740ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 -- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740d4370 msgr2=0x7eff74161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740d4370 0x7eff74161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 -- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff7415eca0 msgr2=0x7eff740ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff7415eca0 0x7eff740ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.392+0000 7eff79280640 1 -- 172.21.15.18:0/583297918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff741f5a70 con 0x7eff740b37e0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff79280640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c760 tx=0x7eff6400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64016020 con 0x7eff740b37e0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff64006d50 con 0x7eff740b37e0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff741f5d50 con 0x7eff740b37e0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64003bb0 con 0x7eff740b37e0 2024-04-16T12:55:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.393+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741f6310 con 0x7eff740b37e0 2024-04-16T12:55:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.394+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff740752b0 con 0x7eff740b37e0 2024-04-16T12:55:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.394+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff6400a850 con 0x7eff740b37e0 2024-04-16T12:55:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.395+0000 7eff71ffb640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 0x7eff6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.395+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff6408b9a0 con 0x7eff740b37e0 2024-04-16T12:55:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.395+0000 7eff78a7f640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 0x7eff6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.396+0000 7eff78a7f640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 0x7eff6006ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff7415bc30 tx=0x7eff68009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.399+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff64020020 con 0x7eff740b37e0 2024-04-16T12:55:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.583+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff740d1f10 con 0x7eff740b37e0 2024-04-16T12:55:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.584+0000 7eff71ffb640 1 -- 172.21.15.18:0/583297918 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7eff64059430 con 0x7eff740b37e0 2024-04-16T12:55:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:36.587 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 msgr2=0x7eff6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 0x7eff6006ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff7415bc30 tx=0x7eff68009190 comp rx=0 tx=0).stop 2024-04-16T12:55:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 msgr2=0x7eff7414ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c760 tx=0x7eff6400cc20 comp rx=0 tx=0).stop 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 shutdown_connections 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7eff6006c920 0x7eff6006ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff7415eca0 0x7eff740ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7eff740d4370 0x7eff74161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 --2- 172.21.15.18:0/583297918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff740b37e0 0x7eff7414ee80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.586+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 >> 172.21.15.18:0/583297918 conn(0x7eff740d48b0 msgr2=0x7eff740b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.587+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 shutdown_connections 2024-04-16T12:55:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.587+0000 7eff7b4e4640 1 -- 172.21.15.18:0/583297918 wait complete. 2024-04-16T12:55:36.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:36.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.707+0000 7fad47f24640 1 Processor -- start 2024-04-16T12:55:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.708+0000 7fad47f24640 1 -- start start 2024-04-16T12:55:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.708+0000 7fad47f24640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad4015ee90 0x7fad4006d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad47f24640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad4006da80 con 0x7fad400b0c50 2024-04-16T12:55:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad47f24640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad400d0be0 con 0x7fad4006e440 2024-04-16T12:55:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad47f24640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fad400d0ec0 con 0x7fad4015ee90 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad45cc0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad4015ee90 0x7fad4006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad454bf640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fad400b0c50 0x7fad4006dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37086/0 (socket says 172.21.15.18:37086) 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad454bf640 1 -- 172.21.15.18:0/2596070395 learned_addr learned my addr 172.21.15.18:0/2596070395 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad45cc0640 1 -- 172.21.15.18:0/2596070395 >> v1:172.21.15.104:6789/0 conn(0x7fad4006e440 legacy=0x7fad4006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad45cc0640 1 -- 172.21.15.18:0/2596070395 >> v1:172.21.15.18:6789/0 conn(0x7fad400b0c50 legacy=0x7fad4006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad45cc0640 1 -- 172.21.15.18:0/2596070395 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad400d11a0 con 0x7fad4015ee90 2024-04-16T12:55:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.709+0000 7fad44cbe640 1 -- 172.21.15.18:0/2596070395 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036049845 0 0) 0x7fad4006da80 con 0x7fad400b0c50 2024-04-16T12:55:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad45cc0640 1 --2- 172.21.15.18:0/2596070395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad4015ee90 0x7fad4006d540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad380097d0 tx=0x7fad3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4753c3367b52bce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad44cbe640 1 -- 172.21.15.18:0/2596070395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38034070 con 0x7fad4015ee90 2024-04-16T12:55:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad44cbe640 1 -- 172.21.15.18:0/2596070395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad38030610 con 0x7fad4015ee90 2024-04-16T12:55:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad44cbe640 1 -- 172.21.15.18:0/2596070395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad380309e0 con 0x7fad4015ee90 2024-04-16T12:55:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad47f24640 1 -- 172.21.15.18:0/2596070395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad4015ee90 msgr2=0x7fad4006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad47f24640 1 --2- 172.21.15.18:0/2596070395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad4015ee90 0x7fad4006d540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad380097d0 tx=0x7fad3802b960 comp rx=0 tx=0).stop 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad47f24640 1 -- 172.21.15.18:0/2596070395 shutdown_connections 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad47f24640 1 --2- 172.21.15.18:0/2596070395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad4015ee90 0x7fad4006d540 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.710+0000 7fad47f24640 1 -- 172.21.15.18:0/2596070395 >> 172.21.15.18:0/2596070395 conn(0x7fad4009aa10 msgr2=0x7fad400b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.711+0000 7fad47f24640 1 -- 172.21.15.18:0/2596070395 shutdown_connections 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.711+0000 7fad47f24640 1 -- 172.21.15.18:0/2596070395 wait complete. 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.712+0000 7fad47f24640 1 Processor -- start 2024-04-16T12:55:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.712+0000 7fad47f24640 1 -- start start 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad4006e440 0x7fad401f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 0x7fad4006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad4015f270 con 0x7fad400b0c50 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fad400b3d70 con 0x7fad4015ee90 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad47f24640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fad4015f3f0 con 0x7fad4006e440 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39140/0 (socket says 172.21.15.18:39140) 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 -- 172.21.15.18:0/2502413357 learned_addr learned my addr 172.21.15.18:0/2502413357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad45cc0640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad4006e440 0x7fad401f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad464c1640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 0x7fad4006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 -- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad4006e440 msgr2=0x7fad401f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad4006e440 0x7fad401f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 -- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 msgr2=0x7fad4006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 0x7fad4006ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 -- 172.21.15.18:0/2502413357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4009f0d0 con 0x7fad400b0c50 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad464c1640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 0x7fad4006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.713+0000 7fad454bf640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c430 tx=0x7fad3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.715+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad340074e0 con 0x7fad400b0c50 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.715+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad340047e0 con 0x7fad400b0c50 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.715+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4009bd80 con 0x7fad400b0c50 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.715+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34004c10 con 0x7fad400b0c50 2024-04-16T12:55:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.715+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4009c340 con 0x7fad400b0c50 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.716+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40070bd0 con 0x7fad400b0c50 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.716+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad34011070 con 0x7fad400b0c50 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.716+0000 7fad3e7fc640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 0x7fad2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.717+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fad3408baf0 con 0x7fad400b0c50 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.717+0000 7fad45cc0640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 0x7fad2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.717+0000 7fad45cc0640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 0x7fad2c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad38036000 tx=0x7fad38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.721+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad40070bd0 con 0x7fad400b0c50 2024-04-16T12:55:36.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.906+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad40068a70 con 0x7fad400b0c50 2024-04-16T12:55:36.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.906+0000 7fad3e7fc640 1 -- 172.21.15.18:0/2502413357 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fad34059be0 con 0x7fad400b0c50 2024-04-16T12:55:36.908 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:36.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 msgr2=0x7fad2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 0x7fad2c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad38036000 tx=0x7fad38008030 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 msgr2=0x7fad40159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c430 tx=0x7fad3400c8f0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 shutdown_connections 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fad2c06c8f0 0x7fad2c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4015ee90 0x7fad4006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad400b0c50 0x7fad40159d60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 --2- 172.21.15.18:0/2502413357 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fad4006e440 0x7fad401f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 >> 172.21.15.18:0/2502413357 conn(0x7fad4009aa10 msgr2=0x7fad400b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 shutdown_connections 2024-04-16T12:55:36.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:36.908+0000 7fad47f24640 1 -- 172.21.15.18:0/2502413357 wait complete. 2024-04-16T12:55:36.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.026+0000 7fd6154f2640 1 Processor -- start 2024-04-16T12:55:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.026+0000 7fd6154f2640 1 -- start start 2024-04-16T12:55:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd6154f2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd61015c850 0x7fd6100d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd6154f2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd6100d21a0 0x7fd6100ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd6154f2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6100d0420 con 0x7fd6100cd1d0 2024-04-16T12:55:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd6154f2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd6100cd630 con 0x7fd61015c850 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd6154f2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd6100d0700 con 0x7fd6100d21a0 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd60effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd61015c850 0x7fd6100d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd60effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd61015c850 0x7fd6100d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39146/0 (socket says 172.21.15.18:39146) 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.027+0000 7fd60effd640 1 -- 172.21.15.18:0/2283693417 learned_addr learned my addr 172.21.15.18:0/2283693417 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.028+0000 7fd60effd640 1 -- 172.21.15.18:0/2283693417 >> v2:172.21.15.104:3300/0 conn(0x7fd6100d21a0 msgr2=0x7fd6100ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.028+0000 7fd60effd640 1 --2- 172.21.15.18:0/2283693417 >> v2:172.21.15.104:3300/0 conn(0x7fd6100d21a0 0x7fd6100ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.028+0000 7fd60effd640 1 -- 172.21.15.18:0/2283693417 >> v1:172.21.15.104:6789/0 conn(0x7fd6100cd1d0 legacy=0x7fd6100718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.028+0000 7fd60effd640 1 -- 172.21.15.18:0/2283693417 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6100d09e0 con 0x7fd61015c850 2024-04-16T12:55:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.028+0000 7fd60effd640 1 --2- 172.21.15.18:0/2283693417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015c850 0x7fd6100d1c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b1b50 tx=0x7fd60802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18d9e2b2ae26c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd60dffb640 1 -- 172.21.15.18:0/2283693417 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608035020 con 0x7fd61015c850 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd60dffb640 1 -- 172.21.15.18:0/2283693417 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd608031870 con 0x7fd61015c850 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd60dffb640 1 -- 172.21.15.18:0/2283693417 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608031c40 con 0x7fd61015c850 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 -- 172.21.15.18:0/2283693417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015c850 msgr2=0x7fd6100d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 --2- 172.21.15.18:0/2283693417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015c850 0x7fd6100d1c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b1b50 tx=0x7fd60802b910 comp rx=0 tx=0).stop 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 -- 172.21.15.18:0/2283693417 shutdown_connections 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 --2- 172.21.15.18:0/2283693417 >> v2:172.21.15.104:3300/0 conn(0x7fd6100d21a0 0x7fd6100ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 --2- 172.21.15.18:0/2283693417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015c850 0x7fd6100d1c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 -- 172.21.15.18:0/2283693417 >> 172.21.15.18:0/2283693417 conn(0x7fd6100b4230 msgr2=0x7fd6100b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 -- 172.21.15.18:0/2283693417 shutdown_connections 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.029+0000 7fd6154f2640 1 -- 172.21.15.18:0/2283693417 wait complete. 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.030+0000 7fd6154f2640 1 Processor -- start 2024-04-16T12:55:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.030+0000 7fd6154f2640 1 -- start start 2024-04-16T12:55:37.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 0x7fd6101528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 0x7fd610152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6100d1280 con 0x7fd6100cd1d0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd6100d0fa0 con 0x7fd61015c850 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd6154f2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd61015cc30 con 0x7fd6100d21a0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd60effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd60effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39156/0 (socket says 172.21.15.18:39156) 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd60effd640 1 -- 172.21.15.18:0/3512747952 learned_addr learned my addr 172.21.15.18:0/3512747952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd60f7fe640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 0x7fd610152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.031+0000 7fd60e7fc640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 0x7fd6101528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 -- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 msgr2=0x7fd6101528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 0x7fd6101528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 -- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 msgr2=0x7fd610152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 0x7fd610152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 -- 172.21.15.18:0/3512747952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6100ca5c0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60e7fc640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 0x7fd6101528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60f7fe640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 0x7fd610152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd60effd640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd608000c00 tx=0x7fd6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60803ad60 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6080443f0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6100b7ac0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6080447e0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.032+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6100b7780 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.033+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd610068a70 con 0x7fd6100cd1d0 2024-04-16T12:55:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.033+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd608038020 con 0x7fd6100cd1d0 2024-04-16T12:55:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.034+0000 7fd6077fe640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 0x7fd5f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.034+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd6080ae0d0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.034+0000 7fd60e7fc640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 0x7fd5f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.035+0000 7fd60e7fc640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 0x7fd5f006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b4fd0 tx=0x7fd5f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.038+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd60803f070 con 0x7fd6100cd1d0 2024-04-16T12:55:37.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.223+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd6100b2850 con 0x7fd6100cd1d0 2024-04-16T12:55:37.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.223+0000 7fd6077fe640 1 -- 172.21.15.18:0/3512747952 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fd60807c1c0 con 0x7fd6100cd1d0 2024-04-16T12:55:37.224 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 msgr2=0x7fd5f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 0x7fd5f006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b4fd0 tx=0x7fd5f8008040 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 msgr2=0x7fd6100b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd608000c00 tx=0x7fd6080046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 shutdown_connections 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd5f006c8f0 0x7fd5f006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd61015c850 0x7fd610152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd6100d21a0 0x7fd6101528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 --2- 172.21.15.18:0/3512747952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6100cd1d0 0x7fd6100b7240 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 >> 172.21.15.18:0/3512747952 conn(0x7fd6100b4230 msgr2=0x7fd6100b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 shutdown_connections 2024-04-16T12:55:37.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.225+0000 7fd6154f2640 1 -- 172.21.15.18:0/3512747952 wait complete. 2024-04-16T12:55:37.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:37.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.343+0000 7ff3d3d40640 1 Processor -- start 2024-04-16T12:55:37.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.343+0000 7ff3d3d40640 1 -- start start 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d3d40640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3cc06bb00 0x7ff3cc0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d3d40640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc1600b0 0x7ff3cc0d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d3d40640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc06e0d0 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d3d40640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc06de80 con 0x7ff3cc06bb00 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d3d40640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b29d0 con 0x7ff3cc1600b0 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d12db640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3cc06bb00 0x7ff3cc0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d12db640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3cc06bb00 0x7ff3cc0d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39164/0 (socket says 172.21.15.18:39164) 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d12db640 1 -- 172.21.15.18:0/1602861570 learned_addr learned my addr 172.21.15.18:0/1602861570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.344+0000 7ff3d22dd640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc1600b0 0x7ff3cc0d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.345+0000 7ff3d12db640 1 -- 172.21.15.18:0/1602861570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc1600b0 msgr2=0x7ff3cc0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.345+0000 7ff3d12db640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc1600b0 0x7ff3cc0d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.345+0000 7ff3d12db640 1 -- 172.21.15.18:0/1602861570 >> v1:172.21.15.104:6789/0 conn(0x7ff3cc15fcd0 legacy=0x7ff3cc09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.345+0000 7ff3d12db640 1 -- 172.21.15.18:0/1602861570 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc06e3b0 con 0x7ff3cc06bb00 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.345+0000 7ff3d12db640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06bb00 0x7ff3cc0d1520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00098a0 tx=0x7ff3c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6c473a0bc2b54d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d0ada640 1 -- 172.21.15.18:0/1602861570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00317c0 con 0x7ff3cc06bb00 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d0ada640 1 -- 172.21.15.18:0/1602861570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c0037070 con 0x7ff3cc06bb00 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d0ada640 1 -- 172.21.15.18:0/1602861570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0031b80 con 0x7ff3cc06bb00 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1602861570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06bb00 msgr2=0x7ff3cc0d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06bb00 0x7ff3cc0d1520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00098a0 tx=0x7ff3c002b860 comp rx=0 tx=0).stop 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1602861570 shutdown_connections 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc1600b0 0x7ff3cc0d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1602861570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06bb00 0x7ff3cc0d1520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1602861570 >> 172.21.15.18:0/1602861570 conn(0x7ff3cc0735e0 msgr2=0x7ff3cc0b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1602861570 shutdown_connections 2024-04-16T12:55:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.346+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1602861570 wait complete. 2024-04-16T12:55:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.347+0000 7ff3d3d40640 1 Processor -- start 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.347+0000 7ff3d3d40640 1 -- start start 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 0x7ff3cc14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 0x7ff3cc0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b0b10 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b0990 con 0x7ff3cc1600b0 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d3d40640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b0c90 con 0x7ff3cc06bb00 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d12db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d12db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39180/0 (socket says 172.21.15.18:39180) 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d12db640 1 -- 172.21.15.18:0/1026139807 learned_addr learned my addr 172.21.15.18:0/1026139807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d1adc640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 0x7ff3cc14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.348+0000 7ff3d22dd640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 0x7ff3cc0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 -- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 msgr2=0x7ff3cc14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 0x7ff3cc14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 -- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 msgr2=0x7ff3cc0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 0x7ff3cc0ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 -- 172.21.15.18:0/1026139807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc15de70 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d1adc640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 0x7ff3cc14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d22dd640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 0x7ff3cc0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d12db640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00099c0 tx=0x7ff3c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0032650 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c0032810 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0032c00 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc15e150 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.349+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc15e710 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.350+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc0752b0 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.350+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3c00453f0 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.351+0000 7ff3ca7fc640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 0x7ff3b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.351+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff3c00ade70 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.351+0000 7ff3d1adc640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 0x7ff3b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.351+0000 7ff3d1adc640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 0x7ff3b806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc1f5c30 tx=0x7ff3c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.355+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3c0040070 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.539+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3cc06c3f0 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.539+0000 7ff3ca7fc640 1 -- 172.21.15.18:0/1026139807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7ff3c007b910 con 0x7ff3cc15fcd0 2024-04-16T12:55:37.541 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:37.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 msgr2=0x7ff3b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 0x7ff3b806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc1f5c30 tx=0x7ff3c4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:37.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 msgr2=0x7ff3cc0ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00099c0 tx=0x7ff3c00046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 shutdown_connections 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3b806c8f0 0x7ff3b806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3cc1600b0 0x7ff3cc0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc15fcd0 0x7ff3cc0ce050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 --2- 172.21.15.18:0/1026139807 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3cc06bb00 0x7ff3cc14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.541+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 >> 172.21.15.18:0/1026139807 conn(0x7ff3cc0735e0 msgr2=0x7ff3cc158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.542+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 shutdown_connections 2024-04-16T12:55:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.542+0000 7ff3d3d40640 1 -- 172.21.15.18:0/1026139807 wait complete. 2024-04-16T12:55:37.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:37.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.662+0000 7ff3e4711640 1 Processor -- start 2024-04-16T12:55:37.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.663+0000 7ff3e4711640 1 -- start start 2024-04-16T12:55:37.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.663+0000 7ff3e4711640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 0x7ff3dc0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.663+0000 7ff3e4711640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc06c6c0 con 0x7ff3dc162240 2024-04-16T12:55:37.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.663+0000 7ff3e4711640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc0d2db0 con 0x7ff3dc06d520 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.663+0000 7ff3e4711640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc06c9a0 con 0x7ff3dc06c130 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e24ad640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff3dc162240 0x7ff3dc06ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37092/0 (socket says 172.21.15.18:37092) 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e24ad640 1 -- 172.21.15.18:0/2549741140 learned_addr learned my addr 172.21.15.18:0/2549741140 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e2cae640 1 --2- 172.21.15.18:0/2549741140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 0x7ff3dc0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147601945 0 0) 0x7ff3dc06c6c0 con 0x7ff3dc162240 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3c8003520 con 0x7ff3dc162240 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150796135 0 0) 0x7ff3dc0d2db0 con 0x7ff3dc06d520 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3dc06c6c0 con 0x7ff3dc06d520 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e2cae640 1 -- 172.21.15.18:0/2549741140 >> v1:172.21.15.104:6789/0 conn(0x7ff3dc06d520 legacy=0x7ff3dc06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e2cae640 1 -- 172.21.15.18:0/2549741140 >> v1:172.21.15.18:6789/0 conn(0x7ff3dc162240 legacy=0x7ff3dc06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.664+0000 7ff3e2cae640 1 -- 172.21.15.18:0/2549741140 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc0d3090 con 0x7ff3dc06c130 2024-04-16T12:55:37.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e2cae640 1 --2- 172.21.15.18:0/2549741140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 0x7ff3dc0b7b00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009dc0 tx=0x7ff3d402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaef7fa6778fd628 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4039070 con 0x7ff3dc06c130 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d402cc40 con 0x7ff3dc06c130 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e14ab640 1 -- 172.21.15.18:0/2549741140 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4034440 con 0x7ff3dc06c130 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e4711640 1 -- 172.21.15.18:0/2549741140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 msgr2=0x7ff3dc0b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.665+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2549741140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 0x7ff3dc0b7b00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009dc0 tx=0x7ff3d402be90 comp rx=0 tx=0).stop 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.666+0000 7ff3e4711640 1 -- 172.21.15.18:0/2549741140 shutdown_connections 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.666+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2549741140 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06c130 0x7ff3dc0b7b00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.666+0000 7ff3e4711640 1 -- 172.21.15.18:0/2549741140 >> 172.21.15.18:0/2549741140 conn(0x7ff3dc0d48b0 msgr2=0x7ff3dc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.666+0000 7ff3e4711640 1 -- 172.21.15.18:0/2549741140 shutdown_connections 2024-04-16T12:55:37.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.666+0000 7ff3e4711640 1 -- 172.21.15.18:0/2549741140 wait complete. 2024-04-16T12:55:37.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 Processor -- start 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 -- start start 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06d520 0x7ff3dc149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3dc162240 0x7ff3dc0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0d3c20 con 0x7ff3dc06c130 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0d3aa0 con 0x7ff3dc162240 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.667+0000 7ff3e4711640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc0d3da0 con 0x7ff3dc06d520 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39192/0 (socket says 172.21.15.18:39192) 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 -- 172.21.15.18:0/2822639768 learned_addr learned my addr 172.21.15.18:0/2822639768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e1cac640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06d520 0x7ff3dc149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e2cae640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3dc162240 0x7ff3dc0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 -- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06d520 msgr2=0x7ff3dc149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06d520 0x7ff3dc149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 -- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3dc162240 msgr2=0x7ff3dc0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3dc162240 0x7ff3dc0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 -- 172.21.15.18:0/2822639768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc15cb10 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e24ad640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c410 tx=0x7ff3d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8017070 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d8005ce0 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80072d0 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc15cd90 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.668+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc15d350 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.669+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc15db20 con 0x7ff3dc06c130 2024-04-16T12:55:37.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.670+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3d801a070 con 0x7ff3dc06c130 2024-04-16T12:55:37.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.670+0000 7ff3d2ffd640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 0x7ff3c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.670+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff3d808b0f0 con 0x7ff3dc06c130 2024-04-16T12:55:37.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.670+0000 7ff3e1cac640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 0x7ff3c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.671+0000 7ff3e1cac640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 0x7ff3c006edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ce4c0 tx=0x7ff3cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.674+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3dc15cb10 con 0x7ff3dc06c130 2024-04-16T12:55:37.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.860+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff3dc0752b0 con 0x7ff3dc06c130 2024-04-16T12:55:37.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.860+0000 7ff3d2ffd640 1 -- 172.21.15.18:0/2822639768 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7ff3d8058c20 con 0x7ff3dc06c130 2024-04-16T12:55:37.862 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:37.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 msgr2=0x7ff3c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 0x7ff3c006edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ce4c0 tx=0x7ff3cc009040 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 msgr2=0x7ff3dc0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c410 tx=0x7ff3d800c8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 shutdown_connections 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff3c006c8f0 0x7ff3c006edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3dc162240 0x7ff3dc0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff3dc06d520 0x7ff3dc149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.862+0000 7ff3e4711640 1 --2- 172.21.15.18:0/2822639768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc06c130 0x7ff3dc0cd3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.863+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 >> 172.21.15.18:0/2822639768 conn(0x7ff3dc0d48b0 msgr2=0x7ff3dc0d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.863+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 shutdown_connections 2024-04-16T12:55:37.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.863+0000 7ff3e4711640 1 -- 172.21.15.18:0/2822639768 wait complete. 2024-04-16T12:55:37.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.978+0000 7fdfaf5d6640 1 Processor -- start 2024-04-16T12:55:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.978+0000 7fdfaf5d6640 1 -- start start 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfaf5d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdfa815eca0 0x7fdfa806c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfaf5d6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 0x7fdfa80d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfaf5d6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa80d2d90 con 0x7fdfa80d4370 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfaf5d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa815f080 con 0x7fdfa815eca0 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfaf5d6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa80d3070 con 0x7fdfa80b37e0 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdfa815eca0 0x7fdfa806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdfa815eca0 0x7fdfa806c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39204/0 (socket says 172.21.15.18:39204) 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 -- 172.21.15.18:0/389001663 learned_addr learned my addr 172.21.15.18:0/389001663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfacb71640 1 --2- 172.21.15.18:0/389001663 >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 0x7fdfa80d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 -- 172.21.15.18:0/389001663 >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 msgr2=0x7fdfa80d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:37.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 --2- 172.21.15.18:0/389001663 >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 0x7fdfa80d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 -- 172.21.15.18:0/389001663 >> v1:172.21.15.104:6789/0 conn(0x7fdfa80d4370 legacy=0x7fdfa806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfad372640 1 -- 172.21.15.18:0/389001663 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80d3350 con 0x7fdfa815eca0 2024-04-16T12:55:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.979+0000 7fdfacb71640 1 --2- 172.21.15.18:0/389001663 >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 0x7fdfa80d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.980+0000 7fdfad372640 1 --2- 172.21.15.18:0/389001663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa815eca0 0x7fdfa806c430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8069180 tx=0x7fdfa402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf87d4975f0fcbf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.980+0000 7fdf9ffff640 1 -- 172.21.15.18:0/389001663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4034070 con 0x7fdfa815eca0 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.980+0000 7fdf9ffff640 1 -- 172.21.15.18:0/389001663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa4030860 con 0x7fdfa815eca0 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.980+0000 7fdf9ffff640 1 -- 172.21.15.18:0/389001663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4030c30 con 0x7fdfa815eca0 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/389001663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa815eca0 msgr2=0x7fdfa806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/389001663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa815eca0 0x7fdfa806c430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8069180 tx=0x7fdfa402b9a0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/389001663 shutdown_connections 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/389001663 >> v2:172.21.15.104:3300/0 conn(0x7fdfa80b37e0 0x7fdfa80d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/389001663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa815eca0 0x7fdfa806c430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/389001663 >> 172.21.15.18:0/389001663 conn(0x7fdfa80d48b0 msgr2=0x7fdfa80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/389001663 shutdown_connections 2024-04-16T12:55:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.981+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/389001663 wait complete. 2024-04-16T12:55:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.983+0000 7fdfaf5d6640 1 Processor -- start 2024-04-16T12:55:37.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.983+0000 7fdfaf5d6640 1 -- start start 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdfa80d4370 0x7fdfa80cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfa815eca0 0x7fdfa8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa806c970 con 0x7fdfa80b37e0 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa80d3910 con 0x7fdfa815eca0 2024-04-16T12:55:37.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa806d520 con 0x7fdfa80d4370 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39218/0 (socket says 172.21.15.18:39218) 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 -- 172.21.15.18:0/177488556 learned_addr learned my addr 172.21.15.18:0/177488556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfacb71640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdfa80d4370 0x7fdfa80cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfadb73640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfa815eca0 0x7fdfa8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 -- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdfa80d4370 msgr2=0x7fdfa80cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdfa80d4370 0x7fdfa80cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 -- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfa815eca0 msgr2=0x7fdfa8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfa815eca0 0x7fdfa8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 -- 172.21.15.18:0/177488556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80cad90 con 0x7fdfa80b37e0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfad372640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4034040 con 0x7fdfa80b37e0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa40433f0 con 0x7fdfa80b37e0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.984+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa80cb070 con 0x7fdfa80b37e0 2024-04-16T12:55:37.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.985+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40437e0 con 0x7fdfa80b37e0 2024-04-16T12:55:37.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.985+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa80cc810 con 0x7fdfa80b37e0 2024-04-16T12:55:37.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.986+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa80d0e60 con 0x7fdfa80b37e0 2024-04-16T12:55:37.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.986+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfa4037070 con 0x7fdfa80b37e0 2024-04-16T12:55:37.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.986+0000 7fdf9dffb640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 0x7fdf8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:37.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.987+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdfa40ae090 con 0x7fdfa80b37e0 2024-04-16T12:55:37.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.987+0000 7fdfacb71640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 0x7fdf8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:37.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.987+0000 7fdfacb71640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 0x7fdf8c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80b4010 tx=0x7fdf98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:37.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:37.991+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfa80d0e60 con 0x7fdfa80b37e0 2024-04-16T12:55:38.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.213+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfa80752b0 con 0x7fdfa80b37e0 2024-04-16T12:55:38.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.214+0000 7fdf9dffb640 1 -- 172.21.15.18:0/177488556 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fdfa403e070 con 0x7fdfa80b37e0 2024-04-16T12:55:38.216 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:38.216 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:38.216 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 msgr2=0x7fdf8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 0x7fdf8c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80b4010 tx=0x7fdf98008040 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 msgr2=0x7fdfa80cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa40046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 shutdown_connections 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdf8c06c8f0 0x7fdf8c06edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfa815eca0 0x7fdfa8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdfa80d4370 0x7fdfa80cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 --2- 172.21.15.18:0/177488556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfa80b37e0 0x7fdfa80cf9e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 >> 172.21.15.18:0/177488556 conn(0x7fdfa80d48b0 msgr2=0x7fdfa80d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 shutdown_connections 2024-04-16T12:55:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.216+0000 7fdfaf5d6640 1 -- 172.21.15.18:0/177488556 wait complete. 2024-04-16T12:55:38.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.332+0000 7fa3cbc47640 1 Processor -- start 2024-04-16T12:55:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.332+0000 7fa3cbc47640 1 -- start start 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3cbc47640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3c4148460 0x7fa3c40af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3cbc47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa3c406e520 0x7fa3c406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3cbc47640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c4148840 con 0x7fa3c406c710 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3cbc47640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c40b3c50 con 0x7fa3c4148460 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3cbc47640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c40b3f30 con 0x7fa3c406e520 2024-04-16T12:55:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c99e3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3c4148460 0x7fa3c40af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c91e2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa3c406c710 0x7fa3c40b4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37102/0 (socket says 172.21.15.18:37102) 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c91e2640 1 -- 172.21.15.18:0/3935659308 learned_addr learned my addr 172.21.15.18:0/3935659308 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3ca1e4640 1 --2- 172.21.15.18:0/3935659308 >> v2:172.21.15.104:3300/0 conn(0x7fa3c406e520 0x7fa3c406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c99e3640 1 -- 172.21.15.18:0/3935659308 >> v2:172.21.15.104:3300/0 conn(0x7fa3c406e520 msgr2=0x7fa3c406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c99e3640 1 --2- 172.21.15.18:0/3935659308 >> v2:172.21.15.104:3300/0 conn(0x7fa3c406e520 0x7fa3c406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c99e3640 1 -- 172.21.15.18:0/3935659308 >> v1:172.21.15.18:6789/0 conn(0x7fa3c406c710 legacy=0x7fa3c40b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.333+0000 7fa3c99e3640 1 -- 172.21.15.18:0/3935659308 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c40b4210 con 0x7fa3c4148460 2024-04-16T12:55:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.334+0000 7fa3c99e3640 1 --2- 172.21.15.18:0/3935659308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c4148460 0x7fa3c40af860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4069240 tx=0x7fa3c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ede1075eef35e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.334+0000 7fa3c89e1640 1 -- 172.21.15.18:0/3935659308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0039070 con 0x7fa3c4148460 2024-04-16T12:55:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.334+0000 7fa3c89e1640 1 -- 172.21.15.18:0/3935659308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c002cc80 con 0x7fa3c4148460 2024-04-16T12:55:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.334+0000 7fa3c89e1640 1 -- 172.21.15.18:0/3935659308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0034660 con 0x7fa3c4148460 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 -- 172.21.15.18:0/3935659308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c4148460 msgr2=0x7fa3c40af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/3935659308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c4148460 0x7fa3c40af860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4069240 tx=0x7fa3c002bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 -- 172.21.15.18:0/3935659308 shutdown_connections 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/3935659308 >> v2:172.21.15.104:3300/0 conn(0x7fa3c406e520 0x7fa3c406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/3935659308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c4148460 0x7fa3c40af860 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 -- 172.21.15.18:0/3935659308 >> 172.21.15.18:0/3935659308 conn(0x7fa3c40b2990 msgr2=0x7fa3c40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 -- 172.21.15.18:0/3935659308 shutdown_connections 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.335+0000 7fa3cbc47640 1 -- 172.21.15.18:0/3935659308 wait complete. 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.336+0000 7fa3cbc47640 1 Processor -- start 2024-04-16T12:55:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.336+0000 7fa3cbc47640 1 -- start start 2024-04-16T12:55:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3c406c710 0x7fa3c406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 0x7fa3c4145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c40aff20 con 0x7fa3c406e520 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c40afda0 con 0x7fa3c4148460 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c40b5540 con 0x7fa3c406c710 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39228/0 (socket says 172.21.15.18:39228) 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 -- 172.21.15.18:0/342658870 learned_addr learned my addr 172.21.15.18:0/342658870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c99e3640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3c406c710 0x7fa3c406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3ca1e4640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 0x7fa3c4145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 -- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3c406c710 msgr2=0x7fa3c406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3c406c710 0x7fa3c406ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 -- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 msgr2=0x7fa3c4145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 0x7fa3c4145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 -- 172.21.15.18:0/342658870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c41f7f70 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3ca1e4640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 0x7fa3c4145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3c91e2640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c440 tx=0x7fa3b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4017070 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b4005ce0 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c41f8250 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.337+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40072f0 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.338+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41f8810 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.339+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c40752b0 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.339+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3b401a070 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.339+0000 7fa3ba7fc640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 0x7fa3a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.339+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa3b408b230 con 0x7fa3c406e520 2024-04-16T12:55:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.340+0000 7fa3c99e3640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 0x7fa3a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.340+0000 7fa3c99e3640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 0x7fa3a806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0036000 tx=0x7fa3c0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.343+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3b4059320 con 0x7fa3c406e520 2024-04-16T12:55:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.528+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3c40afad0 con 0x7fa3c406e520 2024-04-16T12:55:38.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.529+0000 7fa3ba7fc640 1 -- 172.21.15.18:0/342658870 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fa3b4058c20 con 0x7fa3c406e520 2024-04-16T12:55:38.531 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:38.531 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 msgr2=0x7fa3a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 0x7fa3a806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0036000 tx=0x7fa3c0030000 comp rx=0 tx=0).stop 2024-04-16T12:55:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 msgr2=0x7fa3c41451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c440 tx=0x7fa3b4001e70 comp rx=0 tx=0).stop 2024-04-16T12:55:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 shutdown_connections 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa3a806c8f0 0x7fa3a806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3c4148460 0x7fa3c4145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3c406e520 0x7fa3c41451c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 --2- 172.21.15.18:0/342658870 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa3c406c710 0x7fa3c406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 >> 172.21.15.18:0/342658870 conn(0x7fa3c40b2990 msgr2=0x7fa3c406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 shutdown_connections 2024-04-16T12:55:38.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.531+0000 7fa3cbc47640 1 -- 172.21.15.18:0/342658870 wait complete. 2024-04-16T12:55:38.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:38.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.651+0000 7f1623dc8640 1 Processor -- start 2024-04-16T12:55:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.651+0000 7f1623dc8640 1 -- start start 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f161c15ed20 0x7f161c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f161c0b3ec0 0x7f161c0d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0d4340 0x7f161c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f161c0cf740 con 0x7f161c0b3ec0 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f161c0cf8e0 con 0x7f161c15ed20 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1623dc8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f161c15f100 con 0x7f161c0d4340 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f161c0b3ec0 0x7f161c0d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f161c0b3ec0 0x7f161c0d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39234/0 (socket says 172.21.15.18:39234) 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 -- 172.21.15.18:0/1573642162 learned_addr learned my addr 172.21.15.18:0/1573642162 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1622365640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0d4340 0x7f161c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621b64640 1 --2- 172.21.15.18:0/1573642162 >> v2:172.21.15.104:3300/0 conn(0x7f161c15ed20 0x7f161c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 -- 172.21.15.18:0/1573642162 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0d4340 msgr2=0x7f161c0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0d4340 0x7f161c0b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 -- 172.21.15.18:0/1573642162 >> v2:172.21.15.104:3300/0 conn(0x7f161c15ed20 msgr2=0x7f161c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 --2- 172.21.15.18:0/1573642162 >> v2:172.21.15.104:3300/0 conn(0x7f161c15ed20 0x7f161c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.652+0000 7f1621363640 1 -- 172.21.15.18:0/1573642162 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161c0cfb30 con 0x7f161c0b3ec0 2024-04-16T12:55:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.653+0000 7f1621363640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0b3ec0 0x7f161c0d3e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f161c08d1a0 tx=0x7f160c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4addb77919353bf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.653+0000 7f1620b62640 1 -- 172.21.15.18:0/1573642162 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c035020 con 0x7f161c0b3ec0 2024-04-16T12:55:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.653+0000 7f1620b62640 1 -- 172.21.15.18:0/1573642162 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c031870 con 0x7f161c0b3ec0 2024-04-16T12:55:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.653+0000 7f1620b62640 1 -- 172.21.15.18:0/1573642162 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c031c40 con 0x7f161c0b3ec0 2024-04-16T12:55:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 -- 172.21.15.18:0/1573642162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0b3ec0 msgr2=0x7f161c0d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0b3ec0 0x7f161c0d3e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f161c08d1a0 tx=0x7f160c02b910 comp rx=0 tx=0).stop 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 -- 172.21.15.18:0/1573642162 shutdown_connections 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0d4340 0x7f161c0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 --2- 172.21.15.18:0/1573642162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0b3ec0 0x7f161c0d3e00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 --2- 172.21.15.18:0/1573642162 >> v2:172.21.15.104:3300/0 conn(0x7f161c15ed20 0x7f161c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 -- 172.21.15.18:0/1573642162 >> 172.21.15.18:0/1573642162 conn(0x7f161c0d1390 msgr2=0x7f161c0d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 -- 172.21.15.18:0/1573642162 shutdown_connections 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.654+0000 7f1623dc8640 1 -- 172.21.15.18:0/1573642162 wait complete. 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.655+0000 7f1623dc8640 1 Processor -- start 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.655+0000 7f1623dc8640 1 -- start start 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0b3ec0 0x7f161c161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f161c15ed20 0x7f161c146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f161c0d38e0 con 0x7f161c0d4340 2024-04-16T12:55:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f161c0d3600 con 0x7f161c15ed20 2024-04-16T12:55:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f161c0d00f0 con 0x7f161c0b3ec0 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39236/0 (socket says 172.21.15.18:39236) 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 -- 172.21.15.18:0/128144791 learned_addr learned my addr 172.21.15.18:0/128144791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621b64640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0b3ec0 0x7f161c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1622365640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f161c15ed20 0x7f161c146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 -- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0b3ec0 msgr2=0x7f161c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0b3ec0 0x7f161c161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 -- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f161c15ed20 msgr2=0x7f161c146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f161c15ed20 0x7f161c146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 -- 172.21.15.18:0/128144791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161c0cb340 con 0x7f161c0d4340 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1621363640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097c0 tx=0x7f160c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c040070 con 0x7f161c0d4340 2024-04-16T12:55:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c030d00 con 0x7f161c0d4340 2024-04-16T12:55:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161c1f4780 con 0x7f161c0d4340 2024-04-16T12:55:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.656+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c035040 con 0x7f161c0d4340 2024-04-16T12:55:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.657+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f161c0cc030 con 0x7f161c0d4340 2024-04-16T12:55:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.657+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161c0752b0 con 0x7f161c0d4340 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.658+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f160c04b060 con 0x7f161c0d4340 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.658+0000 7f16127fc640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 0x7f160006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.658+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f160c0ada90 con 0x7f161c0d4340 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.658+0000 7f1621b64640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 0x7f160006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.659+0000 7f1621b64640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 0x7f160006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1618003b80 tx=0x7f16180098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.662+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f161c0cb340 con 0x7f161c0d4340 2024-04-16T12:55:38.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.847+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f161c067a80 con 0x7f161c0d4340 2024-04-16T12:55:38.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.847+0000 7f16127fc640 1 -- 172.21.15.18:0/128144791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f160c07b530 con 0x7f161c0d4340 2024-04-16T12:55:38.849 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 msgr2=0x7f160006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 0x7f160006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1618003b80 tx=0x7f16180098d0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 msgr2=0x7f161c0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097c0 tx=0x7f160c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 shutdown_connections 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f160006c8f0 0x7f160006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f161c15ed20 0x7f161c146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f161c0d4340 0x7f161c0cae00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 --2- 172.21.15.18:0/128144791 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f161c0b3ec0 0x7f161c161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 >> 172.21.15.18:0/128144791 conn(0x7f161c0d1390 msgr2=0x7f161c0b9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 shutdown_connections 2024-04-16T12:55:38.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.849+0000 7f1623dc8640 1 -- 172.21.15.18:0/128144791 wait complete. 2024-04-16T12:55:38.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:38.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.967+0000 7f39ddc28640 1 Processor -- start 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.967+0000 7f39ddc28640 1 -- start start 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39ddc28640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 0x7f39d81603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39ddc28640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39d80b48c0 0x7f39d80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39ddc28640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d815cc00 con 0x7f39d80ccd80 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39ddc28640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f39d8160a30 con 0x7f39d80b48c0 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39ddc28640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f39d8160d10 con 0x7f39d815c820 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39d80b48c0 0x7f39d80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f39d80ccd80 0x7f39d80b41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37104/0 (socket says 172.21.15.18:37104) 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d6ffd640 1 -- 172.21.15.18:0/1636807078 learned_addr learned my addr 172.21.15.18:0/1636807078 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39d80b48c0 0x7f39d80d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39238/0 (socket says 172.21.15.18:39238) 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d77fe640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 0x7f39d81603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d7fff640 1 -- 172.21.15.18:0/1636807078 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 msgr2=0x7f39d81603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d7fff640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 0x7f39d81603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.968+0000 7f39d7fff640 1 -- 172.21.15.18:0/1636807078 >> v1:172.21.15.18:6789/0 conn(0x7f39d80ccd80 legacy=0x7f39d80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d7fff640 1 -- 172.21.15.18:0/1636807078 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d8160ff0 con 0x7f39d80b48c0 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d67fc640 1 -- 172.21.15.18:0/1636807078 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59619181 0 0) 0x7f39d815cc00 con 0x7f39d80ccd80 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d77fe640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 0x7f39d81603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d7fff640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80b48c0 0x7f39d80d08c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ce23defff1d274 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d67fc640 1 -- 172.21.15.18:0/1636807078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0039070 con 0x7f39d80b48c0 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d67fc640 1 -- 172.21.15.18:0/1636807078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d002cb30 con 0x7f39d80b48c0 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.969+0000 7f39d67fc640 1 -- 172.21.15.18:0/1636807078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0034440 con 0x7f39d80b48c0 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 -- 172.21.15.18:0/1636807078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80b48c0 msgr2=0x7f39d80d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80b48c0 0x7f39d80d08c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009d90 tx=0x7f39d002bd80 comp rx=0 tx=0).stop 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 -- 172.21.15.18:0/1636807078 shutdown_connections 2024-04-16T12:55:38.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80b48c0 0x7f39d80d08c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 --2- 172.21.15.18:0/1636807078 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d815c820 0x7f39d81603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 -- 172.21.15.18:0/1636807078 >> 172.21.15.18:0/1636807078 conn(0x7f39d80cf1b0 msgr2=0x7f39d80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 -- 172.21.15.18:0/1636807078 shutdown_connections 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.970+0000 7f39ddc28640 1 -- 172.21.15.18:0/1636807078 wait complete. 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.971+0000 7f39ddc28640 1 Processor -- start 2024-04-16T12:55:38.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.971+0000 7f39ddc28640 1 -- start start 2024-04-16T12:55:38.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d80b48c0 0x7f39d80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39d815c820 0x7f39d80b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80d0e00 con 0x7f39d80ccd80 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b8260 con 0x7f39d815c820 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39ddc28640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f39d80d0f80 con 0x7f39d80b48c0 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39242/0 (socket says 172.21.15.18:39242) 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 -- 172.21.15.18:0/2120098213 learned_addr learned my addr 172.21.15.18:0/2120098213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d77fe640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d80b48c0 0x7f39d80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 -- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d80b48c0 msgr2=0x7f39d80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d7fff640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39d815c820 0x7f39d80b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d80b48c0 0x7f39d80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 -- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39d815c820 msgr2=0x7f39d80b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39d815c820 0x7f39d80b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.972+0000 7f39d6ffd640 1 -- 172.21.15.18:0/2120098213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d80c80c0 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39d6ffd640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c4a0 tx=0x7f39cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc018070 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0074e0 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d80c83a0 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc004a20 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.973+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d80c8960 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.974+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d8068a70 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.974+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39cc01b070 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.975+0000 7f39bffff640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 0x7f39c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.975+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39cc08b1c0 con 0x7f39d80ccd80 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.975+0000 7f39d77fe640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 0x7f39c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:38.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.975+0000 7f39d77fe640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 0x7f39c406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c7620 tx=0x7f39c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:38.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:38.979+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39cc0592b0 con 0x7f39d80ccd80 2024-04-16T12:55:39.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.162+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f39d80cff70 con 0x7f39d80ccd80 2024-04-16T12:55:39.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.163+0000 7f39bffff640 1 -- 172.21.15.18:0/2120098213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f39cc058bb0 con 0x7f39d80ccd80 2024-04-16T12:55:39.164 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 msgr2=0x7f39c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 0x7f39c406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c7620 tx=0x7f39c8008040 comp rx=0 tx=0).stop 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 msgr2=0x7f39d8150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c4a0 tx=0x7f39cc00c960 comp rx=0 tx=0).stop 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 shutdown_connections 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f39c406c920 0x7f39c406ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39d815c820 0x7f39d80b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39d80ccd80 0x7f39d8150d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 --2- 172.21.15.18:0/2120098213 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f39d80b48c0 0x7f39d80cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 >> 172.21.15.18:0/2120098213 conn(0x7f39d80cf1b0 msgr2=0x7f39d80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 shutdown_connections 2024-04-16T12:55:39.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.165+0000 7f39ddc28640 1 -- 172.21.15.18:0/2120098213 wait complete. 2024-04-16T12:55:39.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:39.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.283+0000 7f33840e4640 1 Processor -- start 2024-04-16T12:55:39.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 -- start start 2024-04-16T12:55:39.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f337c162740 0x7f337c162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f337c163060 0x7f337c0aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c06f170 con 0x7f337c067ff0 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f337c0706a0 con 0x7f337c162740 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.284+0000 7f33840e4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f337c06f410 con 0x7f337c163060 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3381e80640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f337c162740 0x7f337c162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3382681640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f337c067ff0 0x7f337c0af530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37114/0 (socket says 172.21.15.18:37114) 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3382681640 1 -- 172.21.15.18:0/1855313108 learned_addr learned my addr 172.21.15.18:0/1855313108 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f338167f640 1 --2- 172.21.15.18:0/1855313108 >> v2:172.21.15.104:3300/0 conn(0x7f337c163060 0x7f337c0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3381e80640 1 -- 172.21.15.18:0/1855313108 >> v2:172.21.15.104:3300/0 conn(0x7f337c163060 msgr2=0x7f337c0aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3381e80640 1 --2- 172.21.15.18:0/1855313108 >> v2:172.21.15.104:3300/0 conn(0x7f337c163060 0x7f337c0aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3381e80640 1 -- 172.21.15.18:0/1855313108 >> v1:172.21.15.18:6789/0 conn(0x7f337c067ff0 legacy=0x7f337c0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3380e7e640 1 -- 172.21.15.18:0/1855313108 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245371222 0 0) 0x7f337c06f170 con 0x7f337c067ff0 2024-04-16T12:55:39.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.285+0000 7f3381e80640 1 -- 172.21.15.18:0/1855313108 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c06f6f0 con 0x7f337c162740 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f3381e80640 1 --2- 172.21.15.18:0/1855313108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c162b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f336c009d90 tx=0x7f336c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d038f003535fda7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f3380e7e640 1 -- 172.21.15.18:0/1855313108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c039070 con 0x7f337c162740 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f3380e7e640 1 -- 172.21.15.18:0/1855313108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c02cc60 con 0x7f337c162740 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f3380e7e640 1 -- 172.21.15.18:0/1855313108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c034660 con 0x7f337c162740 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 -- 172.21.15.18:0/1855313108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 msgr2=0x7f337c162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 --2- 172.21.15.18:0/1855313108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c162b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f336c009d90 tx=0x7f336c02beb0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 -- 172.21.15.18:0/1855313108 shutdown_connections 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 --2- 172.21.15.18:0/1855313108 >> v2:172.21.15.104:3300/0 conn(0x7f337c163060 0x7f337c0aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 --2- 172.21.15.18:0/1855313108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c162b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.286+0000 7f33840e4640 1 -- 172.21.15.18:0/1855313108 >> 172.21.15.18:0/1855313108 conn(0x7f337c073670 msgr2=0x7f337c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.287+0000 7f33840e4640 1 -- 172.21.15.18:0/1855313108 shutdown_connections 2024-04-16T12:55:39.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.287+0000 7f33840e4640 1 -- 172.21.15.18:0/1855313108 wait complete. 2024-04-16T12:55:39.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 Processor -- start 2024-04-16T12:55:39.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 -- start start 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f337c067ff0 0x7f337c13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f337c163060 0x7f337c141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f337c06ff90 con 0x7f337c162740 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f337c06fcb0 con 0x7f337c067ff0 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.288+0000 7f33840e4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f337c15f960 con 0x7f337c163060 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39264/0 (socket says 172.21.15.18:39264) 2024-04-16T12:55:39.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 -- 172.21.15.18:0/2024133435 learned_addr learned my addr 172.21.15.18:0/2024133435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f3381e80640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f337c067ff0 0x7f337c13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f3382681640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f337c163060 0x7f337c141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 -- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f337c163060 msgr2=0x7f337c141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f337c163060 0x7f337c141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 -- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f337c067ff0 msgr2=0x7f337c13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f337c067ff0 0x7f337c13fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 -- 172.21.15.18:0/2024133435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c1401f0 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f338167f640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f337000e870 tx=0x7f337000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370017070 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337000c940 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337c15da80 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337000cd10 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.289+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337c140da0 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.290+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c068a70 con 0x7f337c162740 2024-04-16T12:55:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.291+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f337001a070 con 0x7f337c162740 2024-04-16T12:55:39.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.291+0000 7f337a7fc640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.291+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f337008bce0 con 0x7f337c162740 2024-04-16T12:55:39.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.292+0000 7f3381e80640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.292+0000 7f3381e80640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f336c036000 tx=0x7f336c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.296+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3370059dd0 con 0x7f337c162740 2024-04-16T12:55:39.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.479+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f337c06de90 con 0x7f337c162740 2024-04-16T12:55:39.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.479+0000 7f337a7fc640 1 -- 172.21.15.18:0/2024133435 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f33700596d0 con 0x7f337c162740 2024-04-16T12:55:39.481 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 msgr2=0x7f336806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f336c036000 tx=0x7f336c030000 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 msgr2=0x7f337c15d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f337000e870 tx=0x7f337000ed30 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 shutdown_connections 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f337c163060 0x7f337c141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f337c162740 0x7f337c15d540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 --2- 172.21.15.18:0/2024133435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f337c067ff0 0x7f337c13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 >> 172.21.15.18:0/2024133435 conn(0x7f337c073670 msgr2=0x7f337c0b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 shutdown_connections 2024-04-16T12:55:39.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.481+0000 7f33840e4640 1 -- 172.21.15.18:0/2024133435 wait complete. 2024-04-16T12:55:39.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.600+0000 7f4e7ffc8640 1 Processor -- start 2024-04-16T12:55:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.600+0000 7f4e7ffc8640 1 -- start start 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7ffc8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e7815ef70 0x7f4e7806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7ffc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4e780d3ed0 0x7f4e7806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7ffc8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e78163480 con 0x7f4e780b3a00 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7ffc8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7815f350 con 0x7f4e7815ef70 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7ffc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f4e780d2470 con 0x7f4e780d3ed0 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7dd64640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e7815ef70 0x7f4e7806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7dd64640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e7815ef70 0x7f4e7806ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39278/0 (socket says 172.21.15.18:39278) 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7dd64640 1 -- 172.21.15.18:0/1975928637 learned_addr learned my addr 172.21.15.18:0/1975928637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.601+0000 7f4e7e565640 1 --2- 172.21.15.18:0/1975928637 >> v2:172.21.15.104:3300/0 conn(0x7f4e780d3ed0 0x7f4e7806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7dd64640 1 -- 172.21.15.18:0/1975928637 >> v2:172.21.15.104:3300/0 conn(0x7f4e780d3ed0 msgr2=0x7f4e7806bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7dd64640 1 --2- 172.21.15.18:0/1975928637 >> v2:172.21.15.104:3300/0 conn(0x7f4e780d3ed0 0x7f4e7806bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7dd64640 1 -- 172.21.15.18:0/1975928637 >> v1:172.21.15.104:6789/0 conn(0x7f4e780b3a00 legacy=0x7f4e780cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7dd64640 1 -- 172.21.15.18:0/1975928637 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e78163760 con 0x7f4e7815ef70 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7dd64640 1 --2- 172.21.15.18:0/1975928637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e7806ba20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e780d25f0 tx=0x7f4e6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3075a13433b6d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7cd62640 1 -- 172.21.15.18:0/1975928637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6802ca70 con 0x7f4e7815ef70 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.602+0000 7f4e7cd62640 1 -- 172.21.15.18:0/1975928637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6802cc10 con 0x7f4e7815ef70 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7cd62640 1 -- 172.21.15.18:0/1975928637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680343f0 con 0x7f4e7815ef70 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/1975928637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 msgr2=0x7f4e7806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/1975928637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e7806ba20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e780d25f0 tx=0x7f4e6802bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/1975928637 shutdown_connections 2024-04-16T12:55:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/1975928637 >> v2:172.21.15.104:3300/0 conn(0x7f4e780d3ed0 0x7f4e7806bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/1975928637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e7806ba20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/1975928637 >> 172.21.15.18:0/1975928637 conn(0x7f4e780b69e0 msgr2=0x7f4e780d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/1975928637 shutdown_connections 2024-04-16T12:55:39.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.603+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/1975928637 wait complete. 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.604+0000 7f4e7ffc8640 1 Processor -- start 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.604+0000 7f4e7ffc8640 1 -- start start 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4e780b3a00 0x7f4e7814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e780d3ed0 0x7f4e780ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780d5160 con 0x7f4e7815ef70 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780d2a30 con 0x7f4e780d3ed0 2024-04-16T12:55:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7ffc8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780b34b0 con 0x7f4e780b3a00 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39286/0 (socket says 172.21.15.18:39286) 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 -- 172.21.15.18:0/226646720 learned_addr learned my addr 172.21.15.18:0/226646720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7d563640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e780d3ed0 0x7f4e780ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7dd64640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4e780b3a00 0x7f4e7814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 -- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4e780b3a00 msgr2=0x7f4e7814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4e780b3a00 0x7f4e7814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 -- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e780d3ed0 msgr2=0x7f4e780ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e780d3ed0 0x7f4e780ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.605+0000 7f4e7e565640 1 -- 172.21.15.18:0/226646720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780cf1a0 con 0x7f4e7815ef70 2024-04-16T12:55:39.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e7e565640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d800 tx=0x7f4e7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000b6c0 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70019070 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e780cf480 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000bac0 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.606+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e780cfa40 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.607+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e780752b0 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.607+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e7000bc60 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.608+0000 7f4e767fc640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 0x7f4e6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.608+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e7008c300 con 0x7f4e7815ef70 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.608+0000 7f4e7dd64640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 0x7f4e6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.608+0000 7f4e7dd64640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 0x7f4e6406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e68035000 tx=0x7f4e68030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.612+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e7005a3f0 con 0x7f4e7815ef70 2024-04-16T12:55:39.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.796+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4e780c77a0 con 0x7f4e7815ef70 2024-04-16T12:55:39.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.796+0000 7f4e767fc640 1 -- 172.21.15.18:0/226646720 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f4e70059cf0 con 0x7f4e7815ef70 2024-04-16T12:55:39.797 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 msgr2=0x7f4e6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 0x7f4e6406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e68035000 tx=0x7f4e68030000 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 msgr2=0x7f4e780ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d800 tx=0x7f4e7000dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 shutdown_connections 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4e6406c8f0 0x7f4e6406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e7815ef70 0x7f4e780ca5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4e780d3ed0 0x7f4e780ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 --2- 172.21.15.18:0/226646720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4e780b3a00 0x7f4e7814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 >> 172.21.15.18:0/226646720 conn(0x7f4e780b69e0 msgr2=0x7f4e780b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 shutdown_connections 2024-04-16T12:55:39.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.798+0000 7f4e7ffc8640 1 -- 172.21.15.18:0/226646720 wait complete. 2024-04-16T12:55:39.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:39.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 Processor -- start 2024-04-16T12:55:39.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 -- start start 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 0x7f15f8070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 0x7f15f809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f8070840 con 0x7f15f809af50 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f15f8070b20 con 0x7f15f80d0ef0 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.914+0000 7f15fdf0e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15f8070e00 con 0x7f15f80cea50 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f15f809af50 0x7f15f8160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37116/0 (socket says 172.21.15.18:37116) 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f7fff640 1 -- 172.21.15.18:0/2036200627 learned_addr learned my addr 172.21.15.18:0/2036200627 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f77fe640 1 --2- 172.21.15.18:0/2036200627 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 0x7f15f8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f6ffd640 1 --2- 172.21.15.18:0/2036200627 >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 0x7f15f809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f67fc640 1 -- 172.21.15.18:0/2036200627 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599977856 0 0) 0x7f15f8070840 con 0x7f15f809af50 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f67fc640 1 -- 172.21.15.18:0/2036200627 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e0003520 con 0x7f15f809af50 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f77fe640 1 -- 172.21.15.18:0/2036200627 >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 msgr2=0x7f15f809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f77fe640 1 --2- 172.21.15.18:0/2036200627 >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 0x7f15f809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f77fe640 1 -- 172.21.15.18:0/2036200627 >> v1:172.21.15.18:6789/0 conn(0x7f15f809af50 legacy=0x7f15f8160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f77fe640 1 -- 172.21.15.18:0/2036200627 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f80710e0 con 0x7f15f80cea50 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.915+0000 7f15f6ffd640 1 --2- 172.21.15.18:0/2036200627 >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 0x7f15f809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.916+0000 7f15f77fe640 1 --2- 172.21.15.18:0/2036200627 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 0x7f15f8070260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15e80097a0 tx=0x7f15e802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c342c06919c4b221 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.916+0000 7f15f67fc640 1 -- 172.21.15.18:0/2036200627 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8034070 con 0x7f15f80cea50 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.916+0000 7f15f67fc640 1 -- 172.21.15.18:0/2036200627 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e8030610 con 0x7f15f80cea50 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.916+0000 7f15f67fc640 1 -- 172.21.15.18:0/2036200627 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e80309c0 con 0x7f15f80cea50 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 -- 172.21.15.18:0/2036200627 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 msgr2=0x7f15f8070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/2036200627 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 0x7f15f8070260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15e80097a0 tx=0x7f15e802b960 comp rx=0 tx=0).stop 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 -- 172.21.15.18:0/2036200627 shutdown_connections 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/2036200627 >> v2:172.21.15.104:3300/0 conn(0x7f15f80d0ef0 0x7f15f809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/2036200627 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80cea50 0x7f15f8070260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 -- 172.21.15.18:0/2036200627 >> 172.21.15.18:0/2036200627 conn(0x7f15f80d2600 msgr2=0x7f15f80d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 -- 172.21.15.18:0/2036200627 shutdown_connections 2024-04-16T12:55:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.917+0000 7f15fdf0e640 1 -- 172.21.15.18:0/2036200627 wait complete. 2024-04-16T12:55:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.918+0000 7f15fdf0e640 1 Processor -- start 2024-04-16T12:55:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.918+0000 7f15fdf0e640 1 -- start start 2024-04-16T12:55:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80cea50 0x7f15f80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80d0ef0 0x7f15f80d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80718e0 con 0x7f15f809af50 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80cee30 con 0x7f15f80cea50 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15fdf0e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80d1330 con 0x7f15f80d0ef0 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39302/0 (socket says 172.21.15.18:39302) 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 -- 172.21.15.18:0/1087496748 learned_addr learned my addr 172.21.15.18:0/1087496748 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f7fff640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80d0ef0 0x7f15f80d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f6ffd640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80cea50 0x7f15f80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 -- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80d0ef0 msgr2=0x7f15f80d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80d0ef0 0x7f15f80d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 -- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80cea50 msgr2=0x7f15f80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80cea50 0x7f15f80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 -- 172.21.15.18:0/1087496748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f80ccb20 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.919+0000 7f15f77fe640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000c00 tx=0x7f15e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.920+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8048070 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.920+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e80044c0 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.920+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8034050 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.920+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f80cc840 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.920+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f80c9a50 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.921+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f80752b0 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.921+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15e804b070 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.921+0000 7f15dffff640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 0x7f15e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.922+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15e80ad9a0 con 0x7f15f809af50 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.922+0000 7f15f6ffd640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 0x7f15e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.922+0000 7f15f6ffd640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 0x7f15e406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15f809c730 tx=0x7f15ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:39.926+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15e807bb20 con 0x7f15f809af50 2024-04-16T12:55:40.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.150+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15f80d3340 con 0x7f15f809af50 2024-04-16T12:55:40.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.151+0000 7f15dffff640 1 -- 172.21.15.18:0/1087496748 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f15e807b420 con 0x7f15f809af50 2024-04-16T12:55:40.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:40.152 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:40.153 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:55:40.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 msgr2=0x7f15e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 0x7f15e406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15f809c730 tx=0x7f15ec008040 comp rx=0 tx=0).stop 2024-04-16T12:55:40.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 msgr2=0x7f15f815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000c00 tx=0x7f15e80046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 shutdown_connections 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15e406c920 0x7f15e406ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15f80d0ef0 0x7f15f80d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15f80cea50 0x7f15f80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 --2- 172.21.15.18:0/1087496748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15f809af50 0x7f15f815e710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 >> 172.21.15.18:0/1087496748 conn(0x7f15f80d2600 msgr2=0x7f15f80b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 shutdown_connections 2024-04-16T12:55:40.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.153+0000 7f15fdf0e640 1 -- 172.21.15.18:0/1087496748 wait complete. 2024-04-16T12:55:40.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.270+0000 7fe6bb774640 1 Processor -- start 2024-04-16T12:55:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.270+0000 7fe6bb774640 1 -- start start 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6bb774640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 0x7fe6b40d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6bb774640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6b40b8b00 0x7fe6b40d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6bb774640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b40cf480 con 0x7fe6b40d2a20 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6bb774640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b40d4660 con 0x7fe6b40b8b00 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6bb774640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b40d2020 con 0x7fe6b40d1700 2024-04-16T12:55:40.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6b40b8b00 0x7fe6b40d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6b40b8b00 0x7fe6b40d2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39312/0 (socket says 172.21.15.18:39312) 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2074433996 learned_addr learned my addr 172.21.15.18:0/2074433996 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9510640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 0x7fe6b40d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2074433996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 msgr2=0x7fe6b40d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 0x7fe6b40d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2074433996 >> v1:172.21.15.104:6789/0 conn(0x7fe6b40d2a20 legacy=0x7fe6b406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2074433996 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40d35c0 con 0x7fe6b40b8b00 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.271+0000 7fe6b9510640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 0x7fe6b40d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6b9d11640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40b8b00 0x7fe6b40d2e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009e50 tx=0x7fe6ac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e14b66beb5d5cb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6abfff640 1 -- 172.21.15.18:0/2074433996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac02cb00 con 0x7fe6b40b8b00 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6abfff640 1 -- 172.21.15.18:0/2074433996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac02cca0 con 0x7fe6b40b8b00 2024-04-16T12:55:40.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6abfff640 1 -- 172.21.15.18:0/2074433996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac034610 con 0x7fe6b40b8b00 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6bb774640 1 -- 172.21.15.18:0/2074433996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40b8b00 msgr2=0x7fe6b40d2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.272+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40b8b00 0x7fe6b40d2e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009e50 tx=0x7fe6ac02bf60 comp rx=0 tx=0).stop 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 -- 172.21.15.18:0/2074433996 shutdown_connections 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40b8b00 0x7fe6b40d2e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2074433996 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40d1700 0x7fe6b40d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 -- 172.21.15.18:0/2074433996 >> 172.21.15.18:0/2074433996 conn(0x7fe6b40b6890 msgr2=0x7fe6b40b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 -- 172.21.15.18:0/2074433996 shutdown_connections 2024-04-16T12:55:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.273+0000 7fe6bb774640 1 -- 172.21.15.18:0/2074433996 wait complete. 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.274+0000 7fe6bb774640 1 Processor -- start 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.274+0000 7fe6bb774640 1 -- start start 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.274+0000 7fe6bb774640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40b8b00 0x7fe6b4158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6b40d1700 0x7fe6b4152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40d3e60 con 0x7fe6b40d2a20 2024-04-16T12:55:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40d3b80 con 0x7fe6b40d1700 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b40d4140 con 0x7fe6b40b8b00 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39324/0 (socket says 172.21.15.18:39324) 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2977010067 learned_addr learned my addr 172.21.15.18:0/2977010067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9510640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40b8b00 0x7fe6b4158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b8d0f640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6b40d1700 0x7fe6b4152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40b8b00 msgr2=0x7fe6b4158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40b8b00 0x7fe6b4158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6b40d1700 msgr2=0x7fe6b4152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6b40d1700 0x7fe6b4152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 -- 172.21.15.18:0/2977010067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b41615f0 con 0x7fe6b40d2a20 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6b9d11640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac036040 tx=0x7fe6ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac043020 con 0x7fe6b40d2a20 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac02ce50 con 0x7fe6b40d2a20 2024-04-16T12:55:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b41618d0 con 0x7fe6b40d2a20 2024-04-16T12:55:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.275+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac009510 con 0x7fe6b40d2a20 2024-04-16T12:55:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.276+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b415f1d0 con 0x7fe6b40d2a20 2024-04-16T12:55:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.277+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b4073c80 con 0x7fe6b40d2a20 2024-04-16T12:55:40.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.277+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6ac005d10 con 0x7fe6b40d2a20 2024-04-16T12:55:40.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.277+0000 7fe6a9ffb640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 0x7fe69806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.278+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6ac0ae780 con 0x7fe6b40d2a20 2024-04-16T12:55:40.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.278+0000 7fe6b9510640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 0x7fe69806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.278+0000 7fe6b9510640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 0x7fe69806ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fd0 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.282+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6b4073c80 con 0x7fe6b40d2a20 2024-04-16T12:55:40.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.469+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6b40752b0 con 0x7fe6b40d2a20 2024-04-16T12:55:40.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.470+0000 7fe6a9ffb640 1 -- 172.21.15.18:0/2977010067 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fe6ac0333a0 con 0x7fe6b40d2a20 2024-04-16T12:55:40.471 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:40.472 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":24,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:14.012972+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:40.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 msgr2=0x7fe69806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 0x7fe69806ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fd0 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 msgr2=0x7fe6b4152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac036040 tx=0x7fe6ac004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 shutdown_connections 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe69806c920 0x7fe69806ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40d2a20 0x7fe6b4152aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6b40d1700 0x7fe6b4152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 --2- 172.21.15.18:0/2977010067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6b40b8b00 0x7fe6b4158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 >> 172.21.15.18:0/2977010067 conn(0x7fe6b40b6890 msgr2=0x7fe6b40b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 shutdown_connections 2024-04-16T12:55:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.472+0000 7fe6bb774640 1 -- 172.21.15.18:0/2977010067 wait complete. 2024-04-16T12:55:40.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:55:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.588+0000 7f0840a1b640 1 Processor -- start 2024-04-16T12:55:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.588+0000 7f0840a1b640 1 -- start start 2024-04-16T12:55:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0840a1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c070260 0x7f083c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0840a1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f083c09af50 0x7f083c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0840a1b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c070840 con 0x7f083c0cea50 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0840a1b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f083c070b20 con 0x7f083c09af50 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0840a1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f083c070e00 con 0x7f083c070260 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f083c09af50 0x7f083c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f083c0cea50 0x7f083c0d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37126/0 (socket says 172.21.15.18:37126) 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f083c09af50 0x7f083c0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39328/0 (socket says 172.21.15.18:39328) 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083a59c640 1 -- 172.21.15.18:0/3698238250 learned_addr learned my addr 172.21.15.18:0/3698238250 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f0839d9b640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c070260 0x7f083c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083ad9d640 1 -- 172.21.15.18:0/3698238250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c070260 msgr2=0x7f083c09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083ad9d640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c070260 0x7f083c09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.589+0000 7f083ad9d640 1 -- 172.21.15.18:0/3698238250 >> v1:172.21.15.18:6789/0 conn(0x7f083c0cea50 legacy=0x7f083c0d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.590+0000 7f083ad9d640 1 -- 172.21.15.18:0/3698238250 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c0710e0 con 0x7f083c09af50 2024-04-16T12:55:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.590+0000 7f083ad9d640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c09af50 0x7f083c0ccf70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ba62ba4867685b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.590+0000 7f083959a640 1 -- 172.21.15.18:0/3698238250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c039070 con 0x7f083c09af50 2024-04-16T12:55:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.590+0000 7f083959a640 1 -- 172.21.15.18:0/3698238250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c02cce0 con 0x7f083c09af50 2024-04-16T12:55:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.590+0000 7f083959a640 1 -- 172.21.15.18:0/3698238250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c034660 con 0x7f083c09af50 2024-04-16T12:55:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 -- 172.21.15.18:0/3698238250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c09af50 msgr2=0x7f083c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c09af50 0x7f083c0ccf70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c02bf30 comp rx=0 tx=0).stop 2024-04-16T12:55:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 -- 172.21.15.18:0/3698238250 shutdown_connections 2024-04-16T12:55:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c09af50 0x7f083c0ccf70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 --2- 172.21.15.18:0/3698238250 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c070260 0x7f083c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 -- 172.21.15.18:0/3698238250 >> 172.21.15.18:0/3698238250 conn(0x7f083c0d2600 msgr2=0x7f083c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 -- 172.21.15.18:0/3698238250 shutdown_connections 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.591+0000 7f0840a1b640 1 -- 172.21.15.18:0/3698238250 wait complete. 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.592+0000 7f0840a1b640 1 Processor -- start 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.592+0000 7f0840a1b640 1 -- start start 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 0x7f083c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 0x7f083c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0718e0 con 0x7f083c0cea50 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0cee30 con 0x7f083c070260 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0840a1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f083c0cd4b0 con 0x7f083c09af50 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f083ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f083ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39344/0 (socket says 172.21.15.18:39344) 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f083ad9d640 1 -- 172.21.15.18:0/335025900 learned_addr learned my addr 172.21.15.18:0/335025900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f083a59c640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 0x7f083c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.593+0000 7f0839d9b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 0x7f083c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 -- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 msgr2=0x7f083c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 0x7f083c1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 -- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 msgr2=0x7f083c1f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 0x7f083c1f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 -- 172.21.15.18:0/335025900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c1f6180 con 0x7f083c0cea50 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083a59c640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 0x7f083c1f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0839d9b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 0x7f083c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f083ad9d640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c044020 con 0x7f083c0cea50 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c03f470 con 0x7f083c0cea50 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c1f6460 con 0x7f083c0cea50 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c039040 con 0x7f083c0cea50 2024-04-16T12:55:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.594+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c159800 con 0x7f083c0cea50 2024-04-16T12:55:40.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.595+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c0752b0 con 0x7f083c0cea50 2024-04-16T12:55:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.596+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f082c047020 con 0x7f083c0cea50 2024-04-16T12:55:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.596+0000 7f0832ffd640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.596+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f082c0aea70 con 0x7f083c0cea50 2024-04-16T12:55:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.596+0000 7f083a59c640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.597+0000 7f083a59c640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 0x7f081c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f083c0720d0 tx=0x7f0834009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:40.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.601+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f082c04e030 con 0x7f083c0cea50 2024-04-16T12:55:40.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.824+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083c0d3340 con 0x7f083c0cea50 2024-04-16T12:55:40.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.825+0000 7f0832ffd640 1 -- 172.21.15.18:0/335025900 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f082c07cbf0 con 0x7f083c0cea50 2024-04-16T12:55:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:40.827 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:55:40.827 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 msgr2=0x7f081c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 0x7f081c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f083c0720d0 tx=0x7f0834009040 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 msgr2=0x7f083c155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 shutdown_connections 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c0cea50 0x7f083c155af0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f083c09af50 0x7f083c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 --2- 172.21.15.18:0/335025900 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f083c070260 0x7f083c1f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 >> 172.21.15.18:0/335025900 conn(0x7f083c0d2600 msgr2=0x7f083c0d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 shutdown_connections 2024-04-16T12:55:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:40.827+0000 7f0840a1b640 1 -- 172.21.15.18:0/335025900 wait complete. 2024-04-16T12:55:41.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T12:55:08.969245+0000', 'modified': '2024-04-16T12:55:31.032697+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54158}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54158': {'gid': 54158, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/2445582295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6835', 'nonce': 2445582295}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 2445582295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 54158, 'qdb_cluster': [54158]} 2024-04-16T12:55:41.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T12:55:41.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-16T12:55:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.351+0000 7f7f0b772640 1 Processor -- start 2024-04-16T12:55:41.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 -- start start 2024-04-16T12:55:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f0406ce10 0x7f7f0406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7f040d3150 0x7f7f040b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0415f0a0 con 0x7f7f040d2ce0 2024-04-16T12:55:41.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7f040d37a0 con 0x7f7f0406ce10 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.352+0000 7f7f0b772640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7f040d3a80 con 0x7f7f040d3150 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f0406ce10 0x7f7f0406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f0406ce10 0x7f7f0406d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39356/0 (socket says 172.21.15.18:39356) 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 -- 172.21.15.18:0/4084611052 learned_addr learned my addr 172.21.15.18:0/4084611052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/4084611052 >> v2:172.21.15.104:3300/0 conn(0x7f7f040d3150 0x7f7f040b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 -- 172.21.15.18:0/4084611052 >> v2:172.21.15.104:3300/0 conn(0x7f7f040d3150 msgr2=0x7f7f040b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 --2- 172.21.15.18:0/4084611052 >> v2:172.21.15.104:3300/0 conn(0x7f7f040d3150 0x7f7f040b8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 -- 172.21.15.18:0/4084611052 >> v1:172.21.15.104:6789/0 conn(0x7f7f040d2ce0 legacy=0x7f7f040cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.353+0000 7f7f0950e640 1 -- 172.21.15.18:0/4084611052 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f040d3d60 con 0x7f7f0406ce10 2024-04-16T12:55:41.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0950e640 1 --2- 172.21.15.18:0/4084611052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0406d1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f040696b0 tx=0x7f7ef402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03b50594b46ceed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f03fff640 1 -- 172.21.15.18:0/4084611052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef402cbb0 con 0x7f7f0406ce10 2024-04-16T12:55:41.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f03fff640 1 -- 172.21.15.18:0/4084611052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef402cd50 con 0x7f7f0406ce10 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f03fff640 1 -- 172.21.15.18:0/4084611052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4034610 con 0x7f7f0406ce10 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 -- 172.21.15.18:0/4084611052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 msgr2=0x7f7f0406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 --2- 172.21.15.18:0/4084611052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0406d1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f040696b0 tx=0x7f7ef402c010 comp rx=0 tx=0).stop 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 -- 172.21.15.18:0/4084611052 shutdown_connections 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 --2- 172.21.15.18:0/4084611052 >> v2:172.21.15.104:3300/0 conn(0x7f7f040d3150 0x7f7f040b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 --2- 172.21.15.18:0/4084611052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0406d1f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 -- 172.21.15.18:0/4084611052 >> 172.21.15.18:0/4084611052 conn(0x7f7f040d48d0 msgr2=0x7f7f040d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 -- 172.21.15.18:0/4084611052 shutdown_connections 2024-04-16T12:55:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.354+0000 7f7f0b772640 1 -- 172.21.15.18:0/4084611052 wait complete. 2024-04-16T12:55:41.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 Processor -- start 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 -- start start 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f040d2ce0 0x7f7f0415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7f040d3150 0x7f7f041f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0406d730 con 0x7f7f0406ce10 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040d4320 con 0x7f7f040d2ce0 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0b772640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0406bc20 con 0x7f7f040d3150 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0950e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0950e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39366/0 (socket says 172.21.15.18:39366) 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.356+0000 7f7f0950e640 1 -- 172.21.15.18:0/3647750867 learned_addr learned my addr 172.21.15.18:0/3647750867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f040d2ce0 0x7f7f0415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7f040d3150 0x7f7f041f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 -- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7f040d3150 msgr2=0x7f7f041f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7f040d3150 0x7f7f041f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 -- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f040d2ce0 msgr2=0x7f7f0415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f040d2ce0 0x7f7f0415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 -- 172.21.15.18:0/3647750867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0415bda0 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000f80 tx=0x7f7ef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f01ffb640 1 -- 172.21.15.18:0/3647750867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4043020 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f01ffb640 1 -- 172.21.15.18:0/3647750867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef403e450 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0415c080 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f01ffb640 1 -- 172.21.15.18:0/3647750867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4009510 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.357+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0415c640 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.359+0000 7f7f01ffb640 1 -- 172.21.15.18:0/3647750867 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ef4046020 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.359+0000 7f7f01ffb640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 0x7f7ef006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.359+0000 7f7f01ffb640 1 -- 172.21.15.18:0/3647750867 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ef40ae660 con 0x7f7f0406ce10 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.359+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 0x7f7ef006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.360+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 0x7f7ef006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7f041595a0 tx=0x7f7ef8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.360+0000 7f7f0e437740 1 Processor -- start 2024-04-16T12:55:41.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.360+0000 7f7f0e437740 1 -- start start 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b2b10 0x55c54e1dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c54e11c9c0 con 0x55c54e1b6670 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c54e0c3650 con 0x55c54e1b2b10 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x55c54e118980 con 0x55c54e1e2af0 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39376/0 (socket says 172.21.15.18:39376) 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3963152003 learned_addr learned my addr 172.21.15.18:0/3963152003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b2b10 0x55c54e1dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 msgr2=0x55c54e1e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b2b10 msgr2=0x55c54e1dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b2b10 0x55c54e1dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.361+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3963152003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54de2f2d0 con 0x55c54e1b6670 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009970 tx=0x7f7efc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8871b3c21fdc9394 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7eeaffd640 1 -- 172.21.15.18:0/3963152003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc018070 con 0x55c54e1b6670 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7eeaffd640 1 -- 172.21.15.18:0/3963152003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc010ca0 con 0x55c54e1b6670 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7eeaffd640 1 -- 172.21.15.18:0/3963152003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f040 con 0x55c54e1b6670 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 -- 172.21.15.18:0/3963152003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 msgr2=0x55c54e1e02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009970 tx=0x7f7efc009190 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 -- 172.21.15.18:0/3963152003 shutdown_connections 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e02a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b2b10 0x55c54e1dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3963152003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 -- 172.21.15.18:0/3963152003 >> 172.21.15.18:0/3963152003 conn(0x55c54e1b4d80 msgr2=0x55c54e1fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 -- 172.21.15.18:0/3963152003 shutdown_connections 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.362+0000 7f7f0e437740 1 -- 172.21.15.18:0/3963152003 wait complete. 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.363+0000 7f7f0e437740 1 -- start start 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.363+0000 7f7f0e437740 1 Processor -- start 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1b6670 0x55c54e1df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e83d0 0x55c54e1e7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c54e1b7820 con 0x55c54e1e2af0 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c54e0d6a10 con 0x55c54e1e83d0 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x55c54e1b6c10 con 0x55c54e1b6670 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0e437740 10 client.0 _ll_register_callbacks cb 0x55c54e0d6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39384/0 (socket says 172.21.15.18:39384) 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 -- 172.21.15.18:0/3866815877 learned_addr learned my addr 172.21.15.18:0/3866815877 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1b6670 0x55c54e1df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e83d0 0x55c54e1e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 -- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1b6670 msgr2=0x55c54e1df110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1b6670 0x55c54e1df110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 -- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e83d0 msgr2=0x55c54e1e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e83d0 0x55c54e1e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.364+0000 7f7f08d0d640 1 -- 172.21.15.18:0/3866815877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54def96b0 con 0x55c54e1e2af0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8003870 tx=0x7f7ef8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd5f2ac11072d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8027060 con 0x55c54e1e2af0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ef8010040 con 0x55c54e1e2af0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7efc010ca0 con 0x55c54e1e2af0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7ef800ea80 con 0x55c54e1e2af0 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 10 client.4818 fetch_fsmap learned FSMap version 9 2024-04-16T12:55:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c54e1eac20 con 0x55c54e1e2af0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc010ca0 con 0x55c54e1e2af0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f7ef800ec20 con 0x55c54e1e2af0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 20 client.4818 populate_metadata read hostname 'smithi018' 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e211920 0x55c54e211d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 4 client.4818 mds_command: new command op to 54158 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 --> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c54e12a3e0 con 0x55c54e211920 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.365+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e211920 0x55c54e211d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.366+0000 7f7ee3fff640 10 client.4818 ms_handle_connect on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.366+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e211920 0x55c54e211d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5353b3ab6b240e25 server_cookie=a03c7bf1c4eb19dc in_seq=0 out_seq=0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3866815877 <== mds.0 v2:172.21.15.104:6835/2445582295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c54e12a3e0 con 0x55c54e211920 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7ee3fff640 10 client.4818 handle_command_reply: tid=0 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 client.4818 shutdown 2024-04-16T12:55:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 msgr2=0x55c54e1eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8003870 tx=0x7f7ef8000ed0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 shutdown_connections 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e211920 0x55c54e211d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e83d0 0x55c54e1e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7ee3fff640 0 client.4818 ms_handle_reset on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e2af0 0x55c54e1eb420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3866815877 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1b6670 0x55c54e1df110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 >> 172.21.15.18:0/3866815877 conn(0x55c54e1b2b10 msgr2=0x55c54e1b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 shutdown_connections 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 1 -- 172.21.15.18:0/3866815877 wait complete. 2024-04-16T12:55:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.367+0000 7f7f0e437740 20 client.4818 trim_cache size 0 max 16384 2024-04-16T12:55:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 Processor -- start 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 -- start start 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 0x55c54e1b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e83d0 0x55c54e1b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04201760 con 0x55c54e1b6670 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04200ac0 con 0x55c54e1e2af0 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7f04201110 con 0x55c54e1e83d0 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.386+0000 7f7f0950e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39386/0 (socket says 172.21.15.18:39386) 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 -- 172.21.15.18:0/514827822 learned_addr learned my addr 172.21.15.18:0/514827822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 0x55c54e1b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e83d0 0x55c54e1b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 -- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e83d0 msgr2=0x55c54e1b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e83d0 0x55c54e1b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 -- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 msgr2=0x55c54e1b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 0x55c54e1b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 -- 172.21.15.18:0/514827822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54e212070 con 0x55c54e1b6670 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 0x55c54e1b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0950e640 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ef407bff0 tx=0x7f7ef4080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a22369c0fd70025 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7eea7fc640 1 -- 172.21.15.18:0/514827822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4099070 con 0x55c54e1b6670 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7eea7fc640 1 -- 172.21.15.18:0/514827822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef407a360 con 0x55c54e1b6670 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7eea7fc640 1 -- 172.21.15.18:0/514827822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40786d0 con 0x55c54e1b6670 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0e437740 1 -- 172.21.15.18:0/514827822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 msgr2=0x55c54e1e4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.387+0000 7f7f0e437740 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ef407bff0 tx=0x7f7ef4080040 comp rx=0 tx=0).stop 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 -- 172.21.15.18:0/514827822 shutdown_connections 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e83d0 0x55c54e1b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1e2af0 0x55c54e1b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 --2- 172.21.15.18:0/514827822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1b6670 0x55c54e1e4ee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 -- 172.21.15.18:0/514827822 >> 172.21.15.18:0/514827822 conn(0x55c54e1b2b10 msgr2=0x55c54e1e5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 -- 172.21.15.18:0/514827822 shutdown_connections 2024-04-16T12:55:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 -- 172.21.15.18:0/514827822 wait complete. 2024-04-16T12:55:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 -- start start 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.388+0000 7f7f0e437740 1 Processor -- start 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 0x55c54e1b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c54e1e79a0 con 0x55c54e1e83d0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c54e1e8d90 con 0x55c54e1b6670 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x55c54e1e5690 con 0x55c54e1e2af0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0e437740 10 client.0 _ll_register_callbacks cb 0x7f7ef8005570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39394/0 (socket says 172.21.15.18:39394) 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3878498431 learned_addr learned my addr 172.21.15.18:0/3878498431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 0x55c54e1b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 msgr2=0x55c54e1ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1ffba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 msgr2=0x55c54e1b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 0x55c54e1b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.389+0000 7f7f09d0f640 1 -- 172.21.15.18:0/3878498431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54e200a60 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f08d0d640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 0x55c54e1b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f09d0f640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00a010 tx=0x7f7efc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0c9e4886a59a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc018040 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7efc004250 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef407a360 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7efc034050 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 10 client.4824 fetch_fsmap learned FSMap version 9 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c54e1b7960 con 0x55c54e1e83d0 2024-04-16T12:55:41.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef407a360 con 0x55c54e1e83d0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f7efc037020 con 0x55c54e1e83d0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 10 client.4824 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 20 client.4824 populate_metadata read hostname 'smithi018' 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e220fb0 0x55c54e27b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 4 client.4824 mds_command: new command op to 54158 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.390+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 --> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] -- command(tid 0: {"prefix": "status"}) -- 0x55c54e124250 con 0x55c54e220fb0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e220fb0 0x55c54e27b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0950e640 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e220fb0 0x55c54e27b050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2bf737ea374e933 server_cookie=5c1fd0e9e91b86bc in_seq=0 out_seq=0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7ee3fff640 10 client.4824 ms_handle_connect on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7ee3fff640 1 -- 172.21.15.18:0/3878498431 <== mds.0 v2:172.21.15.104:6835/2445582295 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c54e124250 con 0x55c54e220fb0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7ee3fff640 10 client.4824 handle_command_reply: tid=0 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 client.4824 shutdown 2024-04-16T12:55:41.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 msgr2=0x55c54e1b8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00a010 tx=0x7f7efc004730 comp rx=0 tx=0).stop 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 shutdown_connections 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c54e1e83d0 0x55c54e1b8160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55c54e1e2af0 0x55c54e1ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:6835/2445582295,v1:172.21.15.104:6837/2445582295] conn(0x55c54e220fb0 0x55c54e27b050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 --2- 172.21.15.18:0/3878498431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c54e1b6670 0x55c54e1b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7ee3fff640 0 client.4824 ms_handle_reset on v2:172.21.15.104:6835/2445582295 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 >> 172.21.15.18:0/3878498431 conn(0x55c54e1b2b10 msgr2=0x55c54e1df840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 shutdown_connections 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 1 -- 172.21.15.18:0/3878498431 wait complete. 2024-04-16T12:55:41.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.391+0000 7f7f0e437740 20 client.4824 trim_cache size 0 max 16384 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "4f03925b-4efb-4ceb-afe9-e5d42c409d27", 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 54158, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 31.804202411999999, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 9, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 24, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 24, 2024-04-16T12:55:41.404 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 39.279899835000002 2024-04-16T12:55:41.405 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 msgr2=0x7f7ef006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 0x7f7ef006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7f041595a0 tx=0x7f7ef8009040 comp rx=0 tx=0).stop 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 msgr2=0x7f7f0415d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000f80 tx=0x7f7ef4004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 shutdown_connections 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ef006c8f0 0x7f7ef006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7f040d3150 0x7f7f041f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f040d2ce0 0x7f7f0415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 --2- 172.21.15.18:0/3647750867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ce10 0x7f7f0415d830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:41.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 >> 172.21.15.18:0/3647750867 conn(0x7f7f040d48d0 msgr2=0x7f7f040d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:41.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 shutdown_connections 2024-04-16T12:55:41.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:41.392+0000 7f7f0b772640 1 -- 172.21.15.18:0/3647750867 wait complete. 2024-04-16T12:55:41.407 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T12:55:41.418 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T12:55:41.418 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T12:55:41.419 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T12:55:41.419 INFO:teuthology.run_tasks:Running task kclient... 2024-04-16T12:55:41.460 INFO:tasks.kclient:Mounting kernel clients... 2024-04-16T12:55:41.461 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-16T12:55:41.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.461 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:55:41.477 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-16T12:55:41.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T12:55:41.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-16T12:55:41.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.647 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:55:41.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-16T12:55:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-04-16T12:55:41.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:55:41.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.734 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:55:41.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-04-16T12:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-04-16T12:55:41.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:55:41.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.831 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:55:41.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:41.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-04-16T12:55:41.961 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-04-16T12:55:41.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:55:41.963 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-16T12:55:41.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:55:41.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T12:55:41.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:55:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.067+0000 7fdc604b8640 1 Processor -- start 2024-04-16T12:55:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.067+0000 7fdc604b8640 1 -- start start 2024-04-16T12:55:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.068+0000 7fdc604b8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc5806c130 0x7fdc580d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.068+0000 7fdc604b8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc58163480 con 0x7fdc5815ef70 2024-04-16T12:55:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.068+0000 7fdc604b8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc58163760 con 0x7fdc580b3a00 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.068+0000 7fdc604b8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5815f350 con 0x7fdc5806c130 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5e254640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdc5815ef70 0x7fdc5806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37130/0 (socket says 172.21.15.18:37130) 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5e254640 1 -- 172.21.15.18:0/597467614 learned_addr learned my addr 172.21.15.18:0/597467614 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5da53640 1 --2- 172.21.15.18:0/597467614 >> v2:172.21.15.104:3300/0 conn(0x7fdc5806c130 0x7fdc580d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318347456 0 0) 0x7fdc58163480 con 0x7fdc5815ef70 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc40003520 con 0x7fdc5815ef70 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319420526 0 0) 0x7fdc58163760 con 0x7fdc580b3a00 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc58163480 con 0x7fdc580b3a00 2024-04-16T12:55:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5da53640 1 -- 172.21.15.18:0/597467614 >> v1:172.21.15.104:6789/0 conn(0x7fdc580b3a00 legacy=0x7fdc580d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1306953111 0 0) 0x7fdc40003520 con 0x7fdc5815ef70 2024-04-16T12:55:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5da53640 1 -- 172.21.15.18:0/597467614 >> v1:172.21.15.18:6789/0 conn(0x7fdc5815ef70 legacy=0x7fdc5806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.069+0000 7fdc5da53640 1 -- 172.21.15.18:0/597467614 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580d26c0 con 0x7fdc5806c130 2024-04-16T12:55:42.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.070+0000 7fdc5da53640 1 --2- 172.21.15.18:0/597467614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc5806c130 0x7fdc580d2ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c97023949cbd92a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:42.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.070+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c038070 con 0x7fdc5806c130 2024-04-16T12:55:42.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.070+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c031500 con 0x7fdc5806c130 2024-04-16T12:55:42.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.070+0000 7fdc5d252640 1 -- 172.21.15.18:0/597467614 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500019f0 con 0x7fdc5806c130 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 -- 172.21.15.18:0/597467614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc5806c130 msgr2=0x7fdc580d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 --2- 172.21.15.18:0/597467614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc5806c130 0x7fdc580d2ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02b820 comp rx=0 tx=0).stop 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 -- 172.21.15.18:0/597467614 shutdown_connections 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 --2- 172.21.15.18:0/597467614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc5806c130 0x7fdc580d2ec0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 -- 172.21.15.18:0/597467614 >> 172.21.15.18:0/597467614 conn(0x7fdc580b69e0 msgr2=0x7fdc580d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 -- 172.21.15.18:0/597467614 shutdown_connections 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.071+0000 7fdc604b8640 1 -- 172.21.15.18:0/597467614 wait complete. 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.072+0000 7fdc604b8640 1 Processor -- start 2024-04-16T12:55:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.072+0000 7fdc604b8640 1 -- start start 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 0x7fdc58161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc580b3a00 0x7fdc580cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580d2a30 con 0x7fdc5815ef70 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580d2470 con 0x7fdc580b3a00 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fdc580b34b0 con 0x7fdc5806c130 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39396/0 (socket says 172.21.15.18:39396) 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 -- 172.21.15.18:0/3200145984 learned_addr learned my addr 172.21.15.18:0/3200145984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5da53640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc580b3a00 0x7fdc580cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5e254640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 0x7fdc58161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 -- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 msgr2=0x7fdc58161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 0x7fdc58161c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 -- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc580b3a00 msgr2=0x7fdc580cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc580b3a00 0x7fdc580cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 -- 172.21.15.18:0/3200145984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580ccd40 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5e254640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 0x7fdc58161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc5ea55640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c400 tx=0x7fdc4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48017070 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc480052d0 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc480037f0 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.073+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc580cd020 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.074+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5815f720 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.074+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580752b0 con 0x7fdc5815ef70 2024-04-16T12:55:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.075+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc4801a070 con 0x7fdc5815ef70 2024-04-16T12:55:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.076+0000 7fdc56ffd640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 0x7fdc4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.076+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc4808b150 con 0x7fdc5815ef70 2024-04-16T12:55:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.076+0000 7fdc5e254640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 0x7fdc4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.076+0000 7fdc5e254640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 0x7fdc4406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc50001560 tx=0x7fdc50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.080+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc48058bf0 con 0x7fdc5815ef70 2024-04-16T12:55:42.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.304+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdc580d1100 con 0x7fdc5815ef70 2024-04-16T12:55:42.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.305+0000 7fdc56ffd640 1 -- 172.21.15.18:0/3200145984 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fdc4805cef0 con 0x7fdc5815ef70 2024-04-16T12:55:42.306 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T12:55:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 msgr2=0x7fdc4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 0x7fdc4406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc50001560 tx=0x7fdc50009040 comp rx=0 tx=0).stop 2024-04-16T12:55:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 msgr2=0x7fdc5814d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:42.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c400 tx=0x7fdc4800c8c0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 shutdown_connections 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fdc4406c8f0 0x7fdc4406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc5815ef70 0x7fdc5814d680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc580b3a00 0x7fdc580cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 --2- 172.21.15.18:0/3200145984 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fdc5806c130 0x7fdc58161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.306+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 >> 172.21.15.18:0/3200145984 conn(0x7fdc580b69e0 msgr2=0x7fdc580b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.307+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 shutdown_connections 2024-04-16T12:55:42.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42.307+0000 7fdc604b8640 1 -- 172.21.15.18:0/3200145984 wait complete. 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T12:55:42.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T12:55:42.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:55:42.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:55:42.320 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T12:55:42.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:42.320 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-16T12:55:42.336 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:42.336 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:42.336 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:42.336 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:42.336 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-16T12:55:42.337 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-04-16T12:55:42.338 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link noprefixroute 2024-04-16T12:55:42.338 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:42.338 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:42.338 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:42.338 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-16T12:55:42.338 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T12:55:42.338 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:42.338 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:42.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-16T12:55:42.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-16T12:55:42.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-16T12:55:42.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T12:55:42.339 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:42.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:42.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:42.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:42.489 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:55:42.517 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-16T12:55:42.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:42.518 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-16T12:55:42.575 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-16T12:55:42.576 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:55:42.576 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T12:55:42.576 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T12:55:42.576 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:55:42.576 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:42.576 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:42.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T12:55:42.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T12:55:42.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T12:55:42.577 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:42.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:42.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:42.715 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:55:42.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:42.731 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-16T12:55:42.787 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:42.787 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:42.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:55:42.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T12:55:42.787 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:42.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:42.911 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T12:55:42.911 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:42.911 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:42.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T12:55:42.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T12:55:42.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T12:55:42.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T12:55:42.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T12:55:42.912 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:43.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.041 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:43.041 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:43.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-16T12:55:43.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T12:55:43.041 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:43.125 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T12:55:43.141 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T12:55:43.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:43.141 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T12:55:43.196 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T12:55:43.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:43.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T12:55:43.284 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T12:55:43.285 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T12:55:43.285 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:43.393 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T12:55:43.394 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T12:55:43.394 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:43.394 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:43.394 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:43.411 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T12:55:43.411 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T12:55:43.411 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:43.411 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790" 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790:/ 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4f03925b-4efb-4ceb-afe9-e5d42c409d27" will pass to kernel 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T12:55:43.412 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T12:55:43.414 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T12:55:43.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:43.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T12:55:43.442 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:43.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:43.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.540 INFO:teuthology.orchestra.run.smithi018.stdout:client4833 2024-04-16T12:55:43.540 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:43.541 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:43.558 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:43.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:43.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.655 INFO:teuthology.orchestra.run.smithi018.stdout:client4833 2024-04-16T12:55:43.655 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.712 INFO:teuthology.orchestra.run.smithi018.stdout:client4833 2024-04-16T12:55:43.712 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f03925b-4efb-4ceb-afe9-e5d42c409d27.client4833/status') 2024-04-16T12:55:43.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:43.775 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4833 (3)192.168.0.1:0/2777462168 2024-04-16T12:55:43.775 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-04-16T12:55:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-04-16T12:55:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-04-16T12:55:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:69 bytes copied, 2.2894e-05 s, 3.0 MB/s 2024-04-16T12:55:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:43.783 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-16T12:55:43.783 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:55:43.783 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T12:55:43.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:55:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.886+0000 7f5a8d86a640 1 Processor -- start 2024-04-16T12:55:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.886+0000 7f5a8d86a640 1 -- start start 2024-04-16T12:55:43.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a8d86a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a8815ef70 0x7f5a8806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:43.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a8d86a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a880d01b0 con 0x7f5a880b3a00 2024-04-16T12:55:43.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a8d86a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a88163480 con 0x7f5a880d3ed0 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a8d86a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8815f350 con 0x7f5a8815ef70 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a86ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a8815ef70 0x7f5a8806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a7e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5a880b3a00 0x7f5a880cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55136/0 (socket says 172.21.15.18:55136) 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a7e7fc640 1 -- 172.21.15.18:0/3592460475 learned_addr learned my addr 172.21.15.18:0/3592460475 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a86ffd640 1 -- 172.21.15.18:0/3592460475 >> v1:172.21.15.104:6789/0 conn(0x7f5a880d3ed0 legacy=0x7f5a880cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a86ffd640 1 -- 172.21.15.18:0/3592460475 >> v1:172.21.15.18:6789/0 conn(0x7f5a880b3a00 legacy=0x7f5a880cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.887+0000 7f5a86ffd640 1 -- 172.21.15.18:0/3592460475 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a88163760 con 0x7f5a8815ef70 2024-04-16T12:55:43.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a86ffd640 1 --2- 172.21.15.18:0/3592460475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8815ef70 0x7f5a8806ba20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5a780097a0 tx=0x7f5a7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd100db07de25c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:43.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a867fc640 1 -- 172.21.15.18:0/3592460475 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78035020 con 0x7f5a8815ef70 2024-04-16T12:55:43.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a867fc640 1 -- 172.21.15.18:0/3592460475 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78031830 con 0x7f5a8815ef70 2024-04-16T12:55:43.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a867fc640 1 -- 172.21.15.18:0/3592460475 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78031c00 con 0x7f5a8815ef70 2024-04-16T12:55:43.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a8d86a640 1 -- 172.21.15.18:0/3592460475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8815ef70 msgr2=0x7f5a8806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:43.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/3592460475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8815ef70 0x7f5a8806ba20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5a780097a0 tx=0x7f5a7802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:43.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a8d86a640 1 -- 172.21.15.18:0/3592460475 shutdown_connections 2024-04-16T12:55:43.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/3592460475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8815ef70 0x7f5a8806ba20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.888+0000 7f5a8d86a640 1 -- 172.21.15.18:0/3592460475 >> 172.21.15.18:0/3592460475 conn(0x7f5a880b69e0 msgr2=0x7f5a880d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.889+0000 7f5a8d86a640 1 -- 172.21.15.18:0/3592460475 shutdown_connections 2024-04-16T12:55:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.889+0000 7f5a8d86a640 1 -- 172.21.15.18:0/3592460475 wait complete. 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.890+0000 7f5a8d86a640 1 Processor -- start 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.890+0000 7f5a8d86a640 1 -- start start 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 0x7f5a88156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a8815ef70 0x7f5a881eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880d2a30 con 0x7f5a880b3a00 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880d2470 con 0x7f5a880d3ed0 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5a880d5160 con 0x7f5a8815ef70 2024-04-16T12:55:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59280/0 (socket says 172.21.15.18:59280) 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 -- 172.21.15.18:0/2949866360 learned_addr learned my addr 172.21.15.18:0/2949866360 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a7e7fc640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 0x7f5a88156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 -- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a8815ef70 msgr2=0x7f5a881eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a8815ef70 0x7f5a881eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 -- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 msgr2=0x7f5a88156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 0x7f5a88156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 -- 172.21.15.18:0/2949866360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a881eb540 con 0x7f5a880b3a00 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a7e7fc640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 0x7f5a88156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a86ffd640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098c0 tx=0x7f5a780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78041070 con 0x7f5a880b3a00 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7803aa30 con 0x7f5a880b3a00 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78035040 con 0x7f5a880b3a00 2024-04-16T12:55:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a881e9f60 con 0x7f5a880b3a00 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.891+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a881ea520 con 0x7f5a880b3a00 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.892+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a881eab30 con 0x7f5a880b3a00 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.893+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a7804c060 con 0x7f5a880b3a00 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.893+0000 7f5a84ff9640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 0x7f5a6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.893+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a780ad970 con 0x7f5a880b3a00 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.894+0000 7f5a7e7fc640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 0x7f5a6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.894+0000 7f5a7e7fc640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 0x7f5a6806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a880b6260 tx=0x7f5a70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:43.898+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a881eb540 con 0x7f5a880b3a00 2024-04-16T12:55:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.122+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5a880752b0 con 0x7f5a880b3a00 2024-04-16T12:55:44.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.123+0000 7f5a84ff9640 1 -- 172.21.15.18:0/2949866360 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f5a7807b9c0 con 0x7f5a880b3a00 2024-04-16T12:55:44.124 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T12:55:44.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 msgr2=0x7f5a6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:44.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 0x7f5a6806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a880b6260 tx=0x7f5a70009040 comp rx=0 tx=0).stop 2024-04-16T12:55:44.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 msgr2=0x7f5a880ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098c0 tx=0x7f5a780046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 shutdown_connections 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5a6806c920 0x7f5a6806ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5a8815ef70 0x7f5a881eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a880d3ed0 0x7f5a88156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 --2- 172.21.15.18:0/2949866360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b3a00 0x7f5a880ce940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 >> 172.21.15.18:0/2949866360 conn(0x7f5a880b69e0 msgr2=0x7f5a8815d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 shutdown_connections 2024-04-16T12:55:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44.125+0000 7f5a8d86a640 1 -- 172.21.15.18:0/2949866360 wait complete. 2024-04-16T12:55:44.137 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T12:55:44.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:55:44.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-16T12:55:44.137 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-16T12:55:44.137 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T12:55:44.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T12:55:44.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:55:44.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:55:44.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-16T12:55:44.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.138 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-16T12:55:44.154 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-16T12:55:44.155 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42702sec preferred_lft 42702sec 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link noprefixroute 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 46:a1:fc:76:3b:21 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.156 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::9039:95ff:fe3e:9611/64 scope link 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run.smithi018.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 46:a1:fc:76:3b:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44a1:fcff:fe76:3b21/64 scope link tentative 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.157 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:55:44.221 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-16T12:55:44.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.224 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-16T12:55:44.280 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-16T12:55:44.280 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:55:44.280 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T12:55:44.281 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T12:55:44.281 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T12:55:44.281 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:44.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:44.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:44.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.420 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:55:44.435 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T12:55:44.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.436 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-16T12:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-16T12:55:44.491 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:44.491 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:44.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T12:55:44.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-16T12:55:44.491 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:44.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:44.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:44.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T12:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 12:50:4c:3a:d0:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::1050:4cff:fe3a:d0d6/64 scope link 2024-04-16T12:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:44.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T12:55:44.714 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:44.714 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:44.714 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:44.714 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.714 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 12:50:4c:3a:d0:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::1050:4cff:fe3a:d0d6/64 scope link 2024-04-16T12:55:44.715 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:44.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-16T12:55:44.716 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:44.716 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-16T12:55:44.717 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:44.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:44.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:44.887 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:44.888 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-16T12:55:44.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2024-04-16T12:55:44.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T12:55:44.888 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-16T12:55:44.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:44.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:44.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:44.972 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-16T12:55:44.987 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-16T12:55:44.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:44.987 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-16T12:55:45.042 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T12:55:45.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:45.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T12:55:45.128 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T12:55:45.128 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T12:55:45.128 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T12:55:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T12:55:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:45.155 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T12:55:45.155 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T12:55:45.155 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-04-16T12:55:45.155 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790" 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790:/ 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=4f03925b-4efb-4ceb-afe9-e5d42c409d27" will pass to kernel 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T12:55:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T12:55:45.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T12:55:45.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:45.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-16T12:55:45.187 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:45.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:45.284 INFO:teuthology.orchestra.run.smithi018.stdout:client4845 2024-04-16T12:55:45.284 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:45.285 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:45.301 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:45.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:45.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:45.398 INFO:teuthology.orchestra.run.smithi018.stdout:client4845 2024-04-16T12:55:45.398 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:45.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:45.454 INFO:teuthology.orchestra.run.smithi018.stdout:client4845 2024-04-16T12:55:45.454 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f03925b-4efb-4ceb-afe9-e5d42c409d27.client4845/status') 2024-04-16T12:55:45.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:45.516 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4845 (3)192.168.0.2:0/139277177 2024-04-16T12:55:45.516 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-04-16T12:55:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-04-16T12:55:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-04-16T12:55:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:68 bytes copied, 2.0064e-05 s, 3.4 MB/s 2024-04-16T12:55:45.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:45.523 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-16T12:55:45.523 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:55:45.524 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T12:55:45.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:55:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.626+0000 7f20a6150640 1 Processor -- start 2024-04-16T12:55:45.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.626+0000 7f20a6150640 1 -- start start 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f20a6150640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f20a00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f20a6150640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f20a006ca30 0x7f20a006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f20a6150640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a0144dc0 con 0x7f20a01449e0 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f20a6150640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f20a006d3e0 con 0x7f20a006ca30 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f20a6150640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f20a015c400 con 0x7f20a00cd910 2024-04-16T12:55:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f20a01449e0 0x7f20a015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55150/0 (socket says 172.21.15.18:55150) 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209f7fe640 1 -- 172.21.15.18:0/3078418403 learned_addr learned my addr 172.21.15.18:0/3078418403 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209ffff640 1 --2- 172.21.15.18:0/3078418403 >> v2:172.21.15.104:3300/0 conn(0x7f20a006ca30 0x7f20a006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209effd640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f20a00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397969188 0 0) 0x7f20a0144dc0 con 0x7f20a01449e0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.627+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2088003520 con 0x7f20a01449e0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3118784939 0 0) 0x7f2088003520 con 0x7f20a01449e0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 msgr2=0x7f20a00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f20a00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 >> v2:172.21.15.104:3300/0 conn(0x7f20a006ca30 msgr2=0x7f20a006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 --2- 172.21.15.18:0/3078418403 >> v2:172.21.15.104:3300/0 conn(0x7f20a006ca30 0x7f20a006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a00b3fb0 con 0x7f20a01449e0 2024-04-16T12:55:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f2090001670 con 0x7f20a01449e0 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209ffff640 1 --2- 172.21.15.18:0/3078418403 >> v2:172.21.15.104:3300/0 conn(0x7f20a006ca30 0x7f20a006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209effd640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f20a00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 >> v1:172.21.15.18:6789/0 conn(0x7f20a01449e0 legacy=0x7f20a015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f2088004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2088004d40 0x7f20880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20a006d3e0 con 0x7f20880039b0 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20a015c400 con 0x7f2088004d40 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f208800b9c0 con 0x7f20a00cd910 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209effd640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f2088004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209ffff640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2088004d40 0x7f20880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 -- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 msgr2=0x7f2088004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00cd910 0x7f2088004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 -- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2088004d40 msgr2=0x7f20880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2088004d40 0x7f20880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.628+0000 7f209f7fe640 1 -- 172.21.15.18:0/3078418403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2088003520 con 0x7f20880039b0 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.629+0000 7f209f7fe640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f209000c210 tx=0x7f2088005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6db6d438459d85b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.629+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090007d50 con 0x7f20880039b0 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.629+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2090030070 con 0x7f20880039b0 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.629+0000 7f209e7fc640 1 -- 172.21.15.18:0/3078418403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209002cd80 con 0x7f20880039b0 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 -- 172.21.15.18:0/3078418403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 msgr2=0x7f2088003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 --2- 172.21.15.18:0/3078418403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f2088003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f209000c210 tx=0x7f2088005830 comp rx=0 tx=0).stop 2024-04-16T12:55:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f209ffff640 1 -- 172.21.15.18:0/3078418403 reap_dead start 2024-04-16T12:55:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 -- 172.21.15.18:0/3078418403 shutdown_connections 2024-04-16T12:55:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 -- 172.21.15.18:0/3078418403 >> 172.21.15.18:0/3078418403 conn(0x7f20a0071f70 msgr2=0x7f20a0072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 -- 172.21.15.18:0/3078418403 shutdown_connections 2024-04-16T12:55:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.630+0000 7f20a6150640 1 -- 172.21.15.18:0/3078418403 wait complete. 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.631+0000 7f20a6150640 1 Processor -- start 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.631+0000 7f20a6150640 1 -- start start 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20a015abf0 0x7f20a00aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00aac10 0x7f20a013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20a00b4850 con 0x7f20880039b0 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20a00b4570 con 0x7f20a015abf0 2024-04-16T12:55:45.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f20a6150640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f20a00b4b30 con 0x7f20a00aac10 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59292/0 (socket says 172.21.15.18:59292) 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 -- 172.21.15.18:0/2111231288 learned_addr learned my addr 172.21.15.18:0/2111231288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209ffff640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00aac10 0x7f20a013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209effd640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20a015abf0 0x7f20a00aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 -- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00aac10 msgr2=0x7f20a013de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00aac10 0x7f20a013de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 -- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20a015abf0 msgr2=0x7f20a00aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20a015abf0 0x7f20a00aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 -- 172.21.15.18:0/2111231288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a0141120 con 0x7f20880039b0 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f209f7fe640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f209000c210 tx=0x7f2090001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:45.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090045070 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.632+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2090004bf0 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.633+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a0141400 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.633+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090001c90 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.633+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a01419c0 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.633+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a00752b0 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.634+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2090007070 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.634+0000 7f2087fff640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 0x7f208c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.635+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f20900ad020 con 0x7f20880039b0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.635+0000 7f209effd640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 0x7f208c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:45.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.635+0000 7f209effd640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 0x7f208c06ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a0142720 tx=0x7f2094009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:45.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.639+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f209007aba0 con 0x7f20880039b0 2024-04-16T12:55:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.866+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f20a0141dc0 con 0x7f20880039b0 2024-04-16T12:55:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.866+0000 7f2087fff640 1 -- 172.21.15.18:0/2111231288 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f209007eea0 con 0x7f20880039b0 2024-04-16T12:55:45.868 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 msgr2=0x7f208c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 0x7f208c06ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a0142720 tx=0x7f2094009190 comp rx=0 tx=0).stop 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 msgr2=0x7f20a01421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f209000c210 tx=0x7f2090001a40 comp rx=0 tx=0).stop 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 shutdown_connections 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f208c06c920 0x7f208c06ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f20a00aac10 0x7f20a013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20a015abf0 0x7f20a00aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 --2- 172.21.15.18:0/2111231288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20880039b0 0x7f20a01421c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:45.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.868+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 >> 172.21.15.18:0/2111231288 conn(0x7f20a0071f70 msgr2=0x7f20a00b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:45.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.869+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 shutdown_connections 2024-04-16T12:55:45.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:45.869+0000 7f20a6150640 1 -- 172.21.15.18:0/2111231288 wait complete. 2024-04-16T12:55:45.880 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:55:45.881 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T12:55:45.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:45.881 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-04-16T12:55:45.901 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:45.901 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:45.901 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:45.901 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:45.901 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-04-16T12:55:45.902 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42711sec preferred_lft 42711sec 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-04-16T12:55:45.903 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:45.903 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T12:55:45.903 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T12:55:45.904 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:46.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:46.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:46.124 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:55:46.153 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-04-16T12:55:46.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:46.154 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-04-16T12:55:46.228 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-04-16T12:55:46.228 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:55:46.228 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T12:55:46.228 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T12:55:46.229 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T12:55:46.229 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:46.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:46.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:46.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:46.560 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:55:46.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:46.577 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-04-16T12:55:46.633 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:46.633 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:46.633 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T12:55:46.633 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T12:55:46.634 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:46.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:46.762 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T12:55:46.762 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:46.762 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T12:55:46.763 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:46.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:46.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:46.930 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:46.930 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:46.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-04-16T12:55:46.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T12:55:46.930 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:46.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:47.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:47.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:47.018 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T12:55:47.034 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T12:55:47.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:47.034 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T12:55:47.089 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T12:55:47.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:47.090 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T12:55:47.177 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T12:55:47.177 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T12:55:47.177 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:47.297 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T12:55:47.297 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T12:55:47.297 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:47.297 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:47.297 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:47.301 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790" 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790:/ 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=4f03925b-4efb-4ceb-afe9-e5d42c409d27" will pass to kernel 2024-04-16T12:55:47.302 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T12:55:47.303 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-04-16T12:55:47.303 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T12:55:47.303 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T12:55:47.303 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T12:55:47.304 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T12:55:47.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:47.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T12:55:47.333 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:47.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:47.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:47.429 INFO:teuthology.orchestra.run.smithi104.stdout:client4854 2024-04-16T12:55:47.430 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:55:47.430 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:47.445 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:47.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:47.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:47.541 INFO:teuthology.orchestra.run.smithi104.stdout:client4854 2024-04-16T12:55:47.541 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:47.609 INFO:teuthology.orchestra.run.smithi104.stdout:client4854 2024-04-16T12:55:47.609 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f03925b-4efb-4ceb-afe9-e5d42c409d27.client4854/status') 2024-04-16T12:55:47.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4854 (3)172.21.15.104:0/2151446056 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stderr:71 bytes copied, 3.6553e-05 s, 1.9 MB/s 2024-04-16T12:55:47.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:47.680 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-16T12:55:47.680 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T12:55:47.680 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T12:55:47.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T12:55:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.784+0000 7f13202df640 1 Processor -- start 2024-04-16T12:55:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.784+0000 7f13202df640 1 -- start start 2024-04-16T12:55:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f13202df640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13181449e0 0x7f131815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f13202df640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13180cd910 0x7f13180cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f13202df640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1318144dc0 con 0x7f131806ca30 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f13202df640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f13180b3fb0 con 0x7f13181449e0 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f13202df640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f13180b4290 con 0x7f13180cd910 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f131e07b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13181449e0 0x7f131815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f131e07b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13181449e0 0x7f131815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59304/0 (socket says 172.21.15.18:59304) 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f131e07b640 1 -- 172.21.15.18:0/1139411048 learned_addr learned my addr 172.21.15.18:0/1139411048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.785+0000 7f131d87a640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13180cd910 0x7f13180cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.786+0000 7f131e07b640 1 -- 172.21.15.18:0/1139411048 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13180cd910 msgr2=0x7f13180cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.786+0000 7f131e07b640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13180cd910 0x7f13180cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.786+0000 7f131e07b640 1 -- 172.21.15.18:0/1139411048 >> v1:172.21.15.104:6789/0 conn(0x7f131806ca30 legacy=0x7f13180b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.786+0000 7f131e07b640 1 -- 172.21.15.18:0/1139411048 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13180b4570 con 0x7f13181449e0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.786+0000 7f131e07b640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13181449e0 0x7f131815bcf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1308009e50 tx=0x7f130802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f811368083e259e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f131d079640 1 -- 172.21.15.18:0/1139411048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130802cb00 con 0x7f13181449e0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f131d079640 1 -- 172.21.15.18:0/1139411048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130802cca0 con 0x7f13181449e0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f131d079640 1 -- 172.21.15.18:0/1139411048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308034610 con 0x7f13181449e0 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 -- 172.21.15.18:0/1139411048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13181449e0 msgr2=0x7f131815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13181449e0 0x7f131815bcf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1308009e50 tx=0x7f130802bf60 comp rx=0 tx=0).stop 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 -- 172.21.15.18:0/1139411048 shutdown_connections 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f13180cd910 0x7f13180cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 --2- 172.21.15.18:0/1139411048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13181449e0 0x7f131815bcf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 -- 172.21.15.18:0/1139411048 >> 172.21.15.18:0/1139411048 conn(0x7f1318071f70 msgr2=0x7f1318072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 -- 172.21.15.18:0/1139411048 shutdown_connections 2024-04-16T12:55:47.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.787+0000 7f13202df640 1 -- 172.21.15.18:0/1139411048 wait complete. 2024-04-16T12:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.788+0000 7f13202df640 1 Processor -- start 2024-04-16T12:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.788+0000 7f13202df640 1 -- start start 2024-04-16T12:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f131806ca30 0x7f131813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 0x7f1318140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1318145240 con 0x7f13180cd910 2024-04-16T12:55:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f13180b4b30 con 0x7f13181449e0 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f13202df640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f131815c230 con 0x7f131806ca30 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59312/0 (socket says 172.21.15.18:59312) 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 -- 172.21.15.18:0/1080159659 learned_addr learned my addr 172.21.15.18:0/1080159659 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131e07b640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f131806ca30 0x7f131813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131e87c640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 0x7f1318140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 -- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f131806ca30 msgr2=0x7f131813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f131806ca30 0x7f131813e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 -- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 msgr2=0x7f1318140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 0x7f1318140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131d87a640 1 -- 172.21.15.18:0/1080159659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13181f21d0 con 0x7f13180cd910 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.789+0000 7f131e87c640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 0x7f1318140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f131d87a640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f130c00e9b0 tx=0x7f130c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c017070 con 0x7f13180cd910 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130c00c9a0 con 0x7f13180cd910 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13181f2470 con 0x7f13180cd910 2024-04-16T12:55:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c00cd90 con 0x7f13180cd910 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.790+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13181f2a30 con 0x7f13180cd910 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.791+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13180752b0 con 0x7f13180cd910 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.791+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f130c01a070 con 0x7f13180cd910 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.792+0000 7f1316ffd640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 0x7f130406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.792+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f130c08bdf0 con 0x7f13180cd910 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.792+0000 7f131e07b640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 0x7f130406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.792+0000 7f131e07b640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 0x7f130406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1308035000 tx=0x7f1308030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:47.796+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f130c059890 con 0x7f13180cd910 2024-04-16T12:55:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.023+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1318141a50 con 0x7f13180cd910 2024-04-16T12:55:48.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.023+0000 7f1316ffd640 1 -- 172.21.15.18:0/1080159659 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f130c05db90 con 0x7f13180cd910 2024-04-16T12:55:48.028 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T12:55:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 msgr2=0x7f130406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 0x7f130406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1308035000 tx=0x7f1308030000 comp rx=0 tx=0).stop 2024-04-16T12:55:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 msgr2=0x7f13181408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f130c00e9b0 tx=0x7f130c00ee70 comp rx=0 tx=0).stop 2024-04-16T12:55:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 shutdown_connections 2024-04-16T12:55:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f130406c8f0 0x7f130406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13181449e0 0x7f1318140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13180cd910 0x7f13181408b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 --2- 172.21.15.18:0/1080159659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f131806ca30 0x7f131813e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.025+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 >> 172.21.15.18:0/1080159659 conn(0x7f1318071f70 msgr2=0x7f1318072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.026+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 shutdown_connections 2024-04-16T12:55:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:48.026+0000 7f13202df640 1 -- 172.21.15.18:0/1080159659 wait complete. 2024-04-16T12:55:48.039 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T12:55:48.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T12:55:48.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T12:55:48.040 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-16T12:55:48.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.041 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-04-16T12:55:48.059 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:48.060 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:48.060 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:48.060 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.060 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T12:55:48.061 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 7a:cc:39:46:fe:f2 brd ff:ff:ff:ff:ff:ff 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::8091:adff:fe08:e13e/64 scope link 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 7a:cc:39:46:fe:f2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T12:55:48.062 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::78cc:39ff:fe46:fef2/64 scope link tentative 2024-04-16T12:55:48.063 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.063 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T12:55:48.128 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-04-16T12:55:48.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.130 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-04-16T12:55:48.187 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-04-16T12:55:48.187 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T12:55:48.187 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T12:55:48.187 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T12:55:48.187 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T12:55:48.188 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:48.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:48.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:48.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.328 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:55:48.344 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T12:55:48.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.345 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-04-16T12:55:48.400 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-16T12:55:48.400 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:48.401 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:48.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T12:55:48.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-16T12:55:48.401 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:48.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:48.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:48.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.527 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T12:55:48.556 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 56:2e:26:49:b7:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T12:55:48.557 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::542e:26ff:fe49:b722/64 scope link 2024-04-16T12:55:48.558 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.558 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T12:55:48.626 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T12:55:48.626 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T12:55:48.626 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 56:2e:26:49:b7:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T12:55:48.627 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T12:55:48.628 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.628 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::542e:26ff:fe49:b722/64 scope link 2024-04-16T12:55:48.628 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-04-16T12:55:48.629 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-16T12:55:48.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-16T12:55:48.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-16T12:55:48.630 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:48.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:48.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:48.799 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T12:55:48.799 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-04-16T12:55:48.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2024-04-16T12:55:48.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T12:55:48.799 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-04-16T12:55:48.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:48.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:48.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:48.884 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-16T12:55:48.913 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-16T12:55:48.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T12:55:48.913 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-16T12:55:48.970 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T12:55:48.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:48.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T12:55:49.057 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T12:55:49.057 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T12:55:49.058 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:49.066 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T12:55:49.066 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T12:55:49.066 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:49.067 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:49.067 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.104:3300,172.21.15.104:3301" 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790" 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.104:6789,172.21.15.104:6790:/ 2024-04-16T12:55:49.071 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=4f03925b-4efb-4ceb-afe9-e5d42c409d27" will pass to kernel 2024-04-16T12:55:49.072 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-16T12:55:49.072 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-04-16T12:55:49.072 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T12:55:49.072 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T12:55:49.072 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T12:55:49.073 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T12:55:49.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:55:49.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-16T12:55:49.103 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:49.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:49.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:49.198 INFO:teuthology.orchestra.run.smithi104.stdout:client4863 2024-04-16T12:55:49.198 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:55:49.198 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:49.216 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:49.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:49.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:49.313 INFO:teuthology.orchestra.run.smithi104.stdout:client4863 2024-04-16T12:55:49.313 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T12:55:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T12:55:49.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:49.368 INFO:teuthology.orchestra.run.smithi104.stdout:client4863 2024-04-16T12:55:49.369 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f03925b-4efb-4ceb-afe9-e5d42c409d27.client4863/status') 2024-04-16T12:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T12:55:49.432 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4863 (3)172.21.15.104:0/2625755751 2024-04-16T12:55:49.432 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-04-16T12:55:49.433 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-04-16T12:55:49.433 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-04-16T12:55:49.433 INFO:teuthology.orchestra.run.smithi104.stderr:71 bytes copied, 3.632e-05 s, 2.0 MB/s 2024-04-16T12:55:49.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-16T12:55:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T12:55:49.440 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T12:55:49.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:49.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 Processor -- start 2024-04-16T12:55:49.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 -- start start 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9900b7050 0x7ff9900ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99015f020 con 0x7ff9900ccc30 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900d34a0 con 0x7ff9900ce560 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.576+0000 7ff99493d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff9900b82d0 con 0x7ff9900b7050 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98e59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff9900ccc30 0x7ff9900d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55154/0 (socket says 172.21.15.18:55154) 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98e59c640 1 -- 172.21.15.18:0/2187971039 learned_addr learned my addr 172.21.15.18:0/2187971039 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff987fff640 1 --2- 172.21.15.18:0/2187971039 >> v2:172.21.15.104:3300/0 conn(0x7ff9900b7050 0x7ff9900ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863672424 0 0) 0x7ff99015f020 con 0x7ff9900ccc30 2024-04-16T12:55:49.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97c003520 con 0x7ff9900ccc30 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 386862734 0 0) 0x7ff97c003520 con 0x7ff9900ccc30 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 >> v2:172.21.15.104:3300/0 conn(0x7ff9900b7050 msgr2=0x7ff9900ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 --2- 172.21.15.18:0/2187971039 >> v2:172.21.15.104:3300/0 conn(0x7ff9900b7050 0x7ff9900ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 >> v1:172.21.15.104:6789/0 conn(0x7ff9900ce560 legacy=0x7ff9900d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900b76c0 con 0x7ff9900ccc30 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7ff980001670 con 0x7ff9900ccc30 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 >> v1:172.21.15.18:6789/0 conn(0x7ff9900ccc30 legacy=0x7ff9900d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff97c0039b0 0x7ff97c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff97c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff97c0051c0 0x7ff97c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900b82d0 con 0x7ff97c004800 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c00bf80 con 0x7ff97c0039b0 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c00c180 con 0x7ff97c0051c0 2024-04-16T12:55:49.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff987fff640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff97c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98e59c640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff97c0039b0 0x7ff97c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.577+0000 7ff98ed9d640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff97c0051c0 0x7ff97c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 -- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff97c0051c0 msgr2=0x7ff97c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff97c0051c0 0x7ff97c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 -- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff97c0039b0 msgr2=0x7ff97c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff97c0039b0 0x7ff97c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 -- 172.21.15.18:0/2187971039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c003520 con 0x7ff97c004800 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff98ed9d640 1 -- 172.21.15.18:0/2187971039 reap_dead start 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.578+0000 7ff987fff640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff97c004c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff978009ac0 tx=0x7ff97c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1b79be6d400ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978039070 con 0x7ff97c004800 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97802c600 con 0x7ff97c004800 2024-04-16T12:55:49.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff98dd9b640 1 -- 172.21.15.18:0/2187971039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978009690 con 0x7ff97c004800 2024-04-16T12:55:49.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 -- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 msgr2=0x7ff97c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff97c004c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff978009ac0 tx=0x7ff97c005830 comp rx=0 tx=0).stop 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 -- 172.21.15.18:0/2187971039 shutdown_connections 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 --2- 172.21.15.18:0/2187971039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff97c004c80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 -- 172.21.15.18:0/2187971039 >> 172.21.15.18:0/2187971039 conn(0x7ff9900d25e0 msgr2=0x7ff9900d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 -- 172.21.15.18:0/2187971039 shutdown_connections 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.579+0000 7ff99493d640 1 -- 172.21.15.18:0/2187971039 wait complete. 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.581+0000 7ff99493d640 1 Processor -- start 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.581+0000 7ff99493d640 1 -- start start 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 0x7ff9900ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 0x7ff9901f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900b7f60 con 0x7ff97c004800 2024-04-16T12:55:49.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900b7c80 con 0x7ff9900adc50 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff9900ce9b0 con 0x7ff9901f49e0 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59330/0 (socket says 172.21.15.18:59330) 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 -- 172.21.15.18:0/785519394 learned_addr learned my addr 172.21.15.18:0/785519394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98ed9d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 0x7ff9901f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff987fff640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 0x7ff9900ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 -- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 msgr2=0x7ff9901f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 0x7ff9901f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 -- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 msgr2=0x7ff9900ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 0x7ff9900ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 -- 172.21.15.18:0/785519394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900cb100 con 0x7ff97c004800 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff987fff640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 0x7ff9900ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98ed9d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 0x7ff9901f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff98e59c640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9800072c0 tx=0x7ff980007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98000f8e0 con 0x7ff97c004800 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff980018070 con 0x7ff97c004800 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9900cb3e0 con 0x7ff97c004800 2024-04-16T12:55:49.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98000fc80 con 0x7ff97c004800 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.582+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9900cb9a0 con 0x7ff97c004800 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.583+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9900752b0 con 0x7ff97c004800 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.584+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff98001d460 con 0x7ff97c004800 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.584+0000 7ff986ffd640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 0x7ff97006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.584+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7ff98008beb0 con 0x7ff97c004800 2024-04-16T12:55:49.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.584+0000 7ff987fff640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 0x7ff97006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.585+0000 7ff987fff640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 0x7ff97006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff978036000 tx=0x7ff978030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.589+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff980059f70 con 0x7ff97c004800 2024-04-16T12:55:49.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.777+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9900cdac0 con 0x7ff97c004800 2024-04-16T12:55:49.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.778+0000 7ff986ffd640 1 -- 172.21.15.18:0/785519394 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18902 (secure 0 0 0) 0x7ff980059870 con 0x7ff97c004800 2024-04-16T12:55:49.781 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:49.781 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":25,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:48.961342+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 msgr2=0x7ff97006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 0x7ff97006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff978036000 tx=0x7ff978030000 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 msgr2=0x7ff990153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9800072c0 tx=0x7ff980007780 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 shutdown_connections 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff97006c920 0x7ff97006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff9901f49e0 0x7ff9901f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9900adc50 0x7ff9900ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 --2- 172.21.15.18:0/785519394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff97c004800 0x7ff990153b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 >> 172.21.15.18:0/785519394 conn(0x7ff9900d25e0 msgr2=0x7ff99015dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:49.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 shutdown_connections 2024-04-16T12:55:49.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.780+0000 7ff99493d640 1 -- 172.21.15.18:0/785519394 wait complete. 2024-04-16T12:55:49.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:49.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.900+0000 7fa2edbf4640 1 Processor -- start 2024-04-16T12:55:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.900+0000 7fa2edbf4640 1 -- start start 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2edbf4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2e806e200 0x7fa2e80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2edbf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e80ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2edbf4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e80b3de0 con 0x7fa2e80cf520 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2edbf4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e80b62a0 con 0x7fa2e806e200 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2edbf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e815d860 con 0x7fa2e80cd070 2024-04-16T12:55:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2e77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2e806e200 0x7fa2e80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2e6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa2e80cf520 0x7fa2e8160660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55170/0 (socket says 172.21.15.18:55170) 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.901+0000 7fa2e6ffd640 1 -- 172.21.15.18:0/109779287 learned_addr learned my addr 172.21.15.18:0/109779287 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e7fff640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e80ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e77fe640 1 -- 172.21.15.18:0/109779287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 msgr2=0x7fa2e80ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e77fe640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e80ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e77fe640 1 -- 172.21.15.18:0/109779287 >> v1:172.21.15.18:6789/0 conn(0x7fa2e80cf520 legacy=0x7fa2e8160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e77fe640 1 -- 172.21.15.18:0/109779287 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e815db40 con 0x7fa2e806e200 2024-04-16T12:55:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e67fc640 1 -- 172.21.15.18:0/109779287 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182790804 0 0) 0x7fa2dc001110 con 0x7fa2e80cf520 2024-04-16T12:55:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.902+0000 7fa2e77fe640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806e200 0x7fa2e80ce030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097a0 tx=0x7fa2d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee663dcb3b5115c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2e67fc640 1 -- 172.21.15.18:0/109779287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8034070 con 0x7fa2e806e200 2024-04-16T12:55:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2e67fc640 1 -- 172.21.15.18:0/109779287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8030610 con 0x7fa2e806e200 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2e67fc640 1 -- 172.21.15.18:0/109779287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80309e0 con 0x7fa2e806e200 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 -- 172.21.15.18:0/109779287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806e200 msgr2=0x7fa2e80ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806e200 0x7fa2e80ce030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097a0 tx=0x7fa2d802b960 comp rx=0 tx=0).stop 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 -- 172.21.15.18:0/109779287 shutdown_connections 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e80ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/109779287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806e200 0x7fa2e80ce030 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 -- 172.21.15.18:0/109779287 >> 172.21.15.18:0/109779287 conn(0x7fa2e809aa10 msgr2=0x7fa2e80b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 -- 172.21.15.18:0/109779287 shutdown_connections 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.903+0000 7fa2edbf4640 1 -- 172.21.15.18:0/109779287 wait complete. 2024-04-16T12:55:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.904+0000 7fa2edbf4640 1 Processor -- start 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 -- start start 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2e806e200 0x7fa2e8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e8159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e806e5e0 con 0x7fa2e80cf520 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e815e100 con 0x7fa2e806e200 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2edbf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e8160d70 con 0x7fa2e80cd070 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59354/0 (socket says 172.21.15.18:59354) 2024-04-16T12:55:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.905+0000 7fa2e7fff640 1 -- 172.21.15.18:0/1601914169 learned_addr learned my addr 172.21.15.18:0/1601914169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e77fe640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2e806e200 0x7fa2e8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e6ffd640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e8159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 -- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 msgr2=0x7fa2e8159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e8159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 -- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2e806e200 msgr2=0x7fa2e8158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2e806e200 0x7fa2e8158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 -- 172.21.15.18:0/1601914169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e8160300 con 0x7fa2e80cf520 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2e7fff640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000cd70 tx=0x7fa2e000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0003b90 con 0x7fa2e80cf520 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0003d30 con 0x7fa2e80cf520 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0004240 con 0x7fa2e80cf520 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e8160b60 con 0x7fa2e80cf520 2024-04-16T12:55:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.906+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e81605a0 con 0x7fa2e80cf520 2024-04-16T12:55:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.907+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e8075430 con 0x7fa2e80cf520 2024-04-16T12:55:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.908+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2e00043e0 con 0x7fa2e80cf520 2024-04-16T12:55:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.908+0000 7fa2cffff640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 0x7fa2d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.908+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7fa2e008c870 con 0x7fa2e80cf520 2024-04-16T12:55:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.908+0000 7fa2e77fe640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 0x7fa2d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.909+0000 7fa2e77fe640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 0x7fa2d406ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8036000 tx=0x7fa2d803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:49.912+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2e8075430 con 0x7fa2e80cf520 2024-04-16T12:55:50.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.101+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2e81599b0 con 0x7fa2e80cf520 2024-04-16T12:55:50.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.101+0000 7fa2cffff640 1 -- 172.21.15.18:0/1601914169 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa2e005a2e0 con 0x7fa2e80cf520 2024-04-16T12:55:50.103 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 msgr2=0x7fa2d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 0x7fa2d406ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8036000 tx=0x7fa2d803b040 comp rx=0 tx=0).stop 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 msgr2=0x7fa2e815e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000cd70 tx=0x7fa2e000a660 comp rx=0 tx=0).stop 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 shutdown_connections 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa2d406c920 0x7fa2d406ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80cf520 0x7fa2e815e7a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa2e80cd070 0x7fa2e8159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 --2- 172.21.15.18:0/1601914169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2e806e200 0x7fa2e8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 >> 172.21.15.18:0/1601914169 conn(0x7fa2e809aa10 msgr2=0x7fa2e806c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 shutdown_connections 2024-04-16T12:55:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.103+0000 7fa2edbf4640 1 -- 172.21.15.18:0/1601914169 wait complete. 2024-04-16T12:55:50.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.225+0000 7f8a8f39d640 1 Processor -- start 2024-04-16T12:55:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.225+0000 7f8a8f39d640 1 -- start start 2024-04-16T12:55:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.226+0000 7f8a8f39d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8a880b4f80 0x7f8a8806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.226+0000 7f8a8f39d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a8815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.226+0000 7f8a8f39d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880ce020 con 0x7f8a88144f30 2024-04-16T12:55:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.226+0000 7f8a8f39d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8806d3e0 con 0x7f8a880b4f80 2024-04-16T12:55:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.226+0000 7f8a8f39d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b5400 con 0x7f8a8806cf70 2024-04-16T12:55:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8c938640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8a880b4f80 0x7f8a8806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8d139640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8a88144f30 0x7f8a880cd910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55182/0 (socket says 172.21.15.18:55182) 2024-04-16T12:55:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8d139640 1 -- 172.21.15.18:0/658120240 learned_addr learned my addr 172.21.15.18:0/658120240 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8d93a640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a8815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8c938640 1 -- 172.21.15.18:0/658120240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 msgr2=0x7f8a8815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8c938640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a8815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8c938640 1 -- 172.21.15.18:0/658120240 >> v1:172.21.15.18:6789/0 conn(0x7f8a88144f30 legacy=0x7f8a880cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8c938640 1 -- 172.21.15.18:0/658120240 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880b3ee0 con 0x7f8a880b4f80 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.227+0000 7f8a8d93a640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a8815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.228+0000 7f8a8c938640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ca30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0097a0 tx=0x7f8a7c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dbbdc0639fca39 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.228+0000 7f8a7bfff640 1 -- 172.21.15.18:0/658120240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c035020 con 0x7f8a880b4f80 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.228+0000 7f8a7bfff640 1 -- 172.21.15.18:0/658120240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c031810 con 0x7f8a880b4f80 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.228+0000 7f8a7bfff640 1 -- 172.21.15.18:0/658120240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c031be0 con 0x7f8a880b4f80 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 -- 172.21.15.18:0/658120240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a880b4f80 msgr2=0x7f8a8806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ca30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0097a0 tx=0x7f8a7c02b8b0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 -- 172.21.15.18:0/658120240 shutdown_connections 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a8815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/658120240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ca30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 -- 172.21.15.18:0/658120240 >> 172.21.15.18:0/658120240 conn(0x7f8a88071f70 msgr2=0x7f8a88072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 -- 172.21.15.18:0/658120240 shutdown_connections 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.229+0000 7f8a8f39d640 1 -- 172.21.15.18:0/658120240 wait complete. 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.230+0000 7f8a8f39d640 1 Processor -- start 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.230+0000 7f8a8f39d640 1 -- start start 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a88157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b44a0 con 0x7f8a88144f30 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b4af0 con 0x7f8a880b4f80 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8f39d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b4780 con 0x7f8a8806cf70 2024-04-16T12:55:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8d93a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8d93a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59362/0 (socket says 172.21.15.18:59362) 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8d93a640 1 -- 172.21.15.18:0/2328515042 learned_addr learned my addr 172.21.15.18:0/2328515042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8d139640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a88157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8c938640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.231+0000 7f8a8d93a640 1 -- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 msgr2=0x7f8a88157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8d93a640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a88157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8d93a640 1 -- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a880b4f80 msgr2=0x7f8a8806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8d93a640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8d93a640 1 -- 172.21.15.18:0/2328515042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88159600 con 0x7f8a88144f30 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8d93a640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000cef0 tx=0x7f8a8000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8001a070 con 0x7f8a88144f30 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8000d860 con 0x7f8a88144f30 2024-04-16T12:55:50.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88158560 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000dc50 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.232+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88158b20 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.233+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a880752b0 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.234+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a8001d070 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.234+0000 7f8a79ffb640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.234+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8a8008c6e0 con 0x7f8a88144f30 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.234+0000 7f8a8d139640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.235+0000 7f8a8d139640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a84007fd0 tx=0x7f8a84007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.238+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a8005a210 con 0x7f8a88144f30 2024-04-16T12:55:50.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.422+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8a881580b0 con 0x7f8a88144f30 2024-04-16T12:55:50.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.422+0000 7f8a79ffb640 1 -- 172.21.15.18:0/2328515042 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f8a8005e510 con 0x7f8a88144f30 2024-04-16T12:55:50.425 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:50.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 msgr2=0x7f8a6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a84007fd0 tx=0x7f8a84007e80 comp rx=0 tx=0).stop 2024-04-16T12:55:50.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 msgr2=0x7f8a8806bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000cef0 tx=0x7f8a8000a710 comp rx=0 tx=0).stop 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 shutdown_connections 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a88144f30 0x7f8a8806bf60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a880b4f80 0x7f8a8806ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 --2- 172.21.15.18:0/2328515042 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a8806cf70 0x7f8a88157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 >> 172.21.15.18:0/2328515042 conn(0x7f8a88071f70 msgr2=0x7f8a88139a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 shutdown_connections 2024-04-16T12:55:50.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.424+0000 7f8a8f39d640 1 -- 172.21.15.18:0/2328515042 wait complete. 2024-04-16T12:55:50.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:50.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.547+0000 7f3d87c93640 1 Processor -- start 2024-04-16T12:55:50.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 -- start start 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d800b3ec0 0x7f3d800d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8015f100 con 0x7f3d800d4340 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3d800cf740 con 0x7f3d800b3ec0 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.548+0000 7f3d87c93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d800cf8e0 con 0x7f3d8015ed20 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d8522e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d800b3ec0 0x7f3d800d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d86230640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3d800d4340 0x7f3d800b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55184/0 (socket says 172.21.15.18:55184) 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d86230640 1 -- 172.21.15.18:0/1408742535 learned_addr learned my addr 172.21.15.18:0/1408742535 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d85a2f640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d8522e640 1 -- 172.21.15.18:0/1408742535 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 msgr2=0x7f3d800cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d8522e640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d8522e640 1 -- 172.21.15.18:0/1408742535 >> v1:172.21.15.18:6789/0 conn(0x7f3d800d4340 legacy=0x7f3d800b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d8522e640 1 -- 172.21.15.18:0/1408742535 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d800cfb30 con 0x7f3d800b3ec0 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.549+0000 7f3d84a2d640 1 -- 172.21.15.18:0/1408742535 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949206531 0 0) 0x7f3d8015f100 con 0x7f3d800d4340 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d8522e640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d800d3e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e53e452b218e6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d84a2d640 1 -- 172.21.15.18:0/1408742535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74035020 con 0x7f3d800b3ec0 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d84a2d640 1 -- 172.21.15.18:0/1408742535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74031830 con 0x7f3d800b3ec0 2024-04-16T12:55:50.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d84a2d640 1 -- 172.21.15.18:0/1408742535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74031c00 con 0x7f3d800b3ec0 2024-04-16T12:55:50.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 -- 172.21.15.18:0/1408742535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 msgr2=0x7f3d800d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d800d3e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097a0 tx=0x7f3d7402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 -- 172.21.15.18:0/1408742535 shutdown_connections 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d800d3e00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 --2- 172.21.15.18:0/1408742535 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 -- 172.21.15.18:0/1408742535 >> 172.21.15.18:0/1408742535 conn(0x7f3d800d1390 msgr2=0x7f3d800d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 -- 172.21.15.18:0/1408742535 shutdown_connections 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.550+0000 7f3d87c93640 1 -- 172.21.15.18:0/1408742535 wait complete. 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.551+0000 7f3d87c93640 1 Processor -- start 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 -- start start 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d800d4340 0x7f3d801f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d800d38e0 con 0x7f3d800b3ec0 2024-04-16T12:55:50.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d800d3600 con 0x7f3d800d4340 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d87c93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3d800d00f0 con 0x7f3d8015ed20 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d85a2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d85a2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59374/0 (socket says 172.21.15.18:59374) 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.552+0000 7f3d85a2f640 1 -- 172.21.15.18:0/4010630690 learned_addr learned my addr 172.21.15.18:0/4010630690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 -- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 msgr2=0x7f3d800c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 -- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d800d4340 msgr2=0x7f3d801f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d800d4340 0x7f3d801f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 -- 172.21.15.18:0/4010630690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80162080 con 0x7f3d800b3ec0 2024-04-16T12:55:50.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d85a2f640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c820 tx=0x7f3d7800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78015070 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78004240 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d800c8ad0 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800ce10 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.553+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d800c9090 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.554+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d80068b60 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.554+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d78007830 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.555+0000 7f3d7e7fc640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 0x7f3d6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.555+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3d7808be50 con 0x7f3d800b3ec0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.555+0000 7f3d8522e640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 0x7f3d6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.556+0000 7f3d8522e640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 0x7f3d6c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d74036000 tx=0x7f3d74030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.559+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d80068b60 con 0x7f3d800b3ec0 2024-04-16T12:55:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.742+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3d80067a10 con 0x7f3d800b3ec0 2024-04-16T12:55:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.742+0000 7f3d7e7fc640 1 -- 172.21.15.18:0/4010630690 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f3d80067a10 con 0x7f3d800b3ec0 2024-04-16T12:55:50.744 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 msgr2=0x7f3d6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 0x7f3d6c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d74036000 tx=0x7f3d74030000 comp rx=0 tx=0).stop 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 msgr2=0x7f3d801540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c820 tx=0x7f3d7800cce0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 shutdown_connections 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f3d6c06c8f0 0x7f3d6c06edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3d8015ed20 0x7f3d800c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d800d4340 0x7f3d801f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 --2- 172.21.15.18:0/4010630690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d800b3ec0 0x7f3d801540d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 >> 172.21.15.18:0/4010630690 conn(0x7f3d800d1390 msgr2=0x7f3d800d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 shutdown_connections 2024-04-16T12:55:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.744+0000 7f3d87c93640 1 -- 172.21.15.18:0/4010630690 wait complete. 2024-04-16T12:55:50.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:50.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.864+0000 7f5878309640 1 Processor -- start 2024-04-16T12:55:50.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.864+0000 7f5878309640 1 -- start start 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f5878309640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f587006d520 0x7f58700b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f5878309640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f587006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f5878309640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f587006c410 con 0x7f5870162240 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f5878309640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f587006c9a0 con 0x7f587006d520 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f5878309640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f587006c6c0 con 0x7f587006ba20 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58760a5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5870162240 0x7f587006ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55192/0 (socket says 172.21.15.18:55192) 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58760a5640 1 -- 172.21.15.18:0/3198082913 learned_addr learned my addr 172.21.15.18:0/3198082913 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58758a4640 1 --2- 172.21.15.18:0/3198082913 >> v2:172.21.15.104:3300/0 conn(0x7f587006d520 0x7f58700b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58768a6640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f587006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375204242 0 0) 0x7f587006c410 con 0x7f5870162240 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c003520 con 0x7f5870162240 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3449960101 0 0) 0x7f585c003520 con 0x7f5870162240 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 msgr2=0x7f587006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f587006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 >> v2:172.21.15.104:3300/0 conn(0x7f587006d520 msgr2=0x7f58700b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 --2- 172.21.15.18:0/3198082913 >> v2:172.21.15.104:3300/0 conn(0x7f587006d520 0x7f58700b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700d2db0 con 0x7f5870162240 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f586c0019f0 con 0x7f5870162240 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 >> v1:172.21.15.18:6789/0 conn(0x7f5870162240 legacy=0x7f587006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f585c0039b0 0x7f585c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c004800 0x7f585c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f585c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f587006c9a0 con 0x7f585c0039b0 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f587006c6c0 con 0x7f585c004800 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.865+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f585c00b9f0 con 0x7f587006ba20 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f585c0039b0 0x7f585c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58758a4640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c004800 0x7f585c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58768a6640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f585c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 -- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 msgr2=0x7f585c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587006ba20 0x7f585c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 -- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c004800 msgr2=0x7f585c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c004800 0x7f585c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.866+0000 7f58760a5640 1 -- 172.21.15.18:0/3198082913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c003520 con 0x7f585c0039b0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f58760a5640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f585c0039b0 0x7f585c003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f586c00a8a0 tx=0x7f585c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92391dcbfec46280 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c00a4c0 con 0x7f585c0039b0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c034650 con 0x7f585c0039b0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f58750a3640 1 -- 172.21.15.18:0/3198082913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c034a40 con 0x7f585c0039b0 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 -- 172.21.15.18:0/3198082913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f585c0039b0 msgr2=0x7f585c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 --2- 172.21.15.18:0/3198082913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f585c0039b0 0x7f585c003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f586c00a8a0 tx=0x7f585c005830 comp rx=0 tx=0).stop 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f58768a6640 1 -- 172.21.15.18:0/3198082913 reap_dead start 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 -- 172.21.15.18:0/3198082913 shutdown_connections 2024-04-16T12:55:50.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 -- 172.21.15.18:0/3198082913 >> 172.21.15.18:0/3198082913 conn(0x7f58700d48b0 msgr2=0x7f58700d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 -- 172.21.15.18:0/3198082913 shutdown_connections 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.867+0000 7f5878309640 1 -- 172.21.15.18:0/3198082913 wait complete. 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 Processor -- start 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 -- start start 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c0039b0 0x7f5870150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587015e230 0x7f58700addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f587006c050 con 0x7f58700b8f20 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f587006bed0 con 0x7f585c0039b0 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f5878309640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f587006c1d0 con 0x7f587015e230 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f58768a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f58768a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59390/0 (socket says 172.21.15.18:59390) 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.869+0000 7f58768a6640 1 -- 172.21.15.18:0/3949121155 learned_addr learned my addr 172.21.15.18:0/3949121155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58758a4640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587015e230 0x7f58700addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 -- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587015e230 msgr2=0x7f58700addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58760a5640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c0039b0 0x7f5870150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587015e230 0x7f58700addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 -- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c0039b0 msgr2=0x7f5870150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c0039b0 0x7f5870150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 -- 172.21.15.18:0/3949121155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700acd60 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f58768a6640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58700ba4c0 tx=0x7f5868011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868004240 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586801b070 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586800f770 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58700ad000 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.870+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58700ad5c0 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.871+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58700752b0 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.872+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5868012040 con 0x7f58700b8f20 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.872+0000 7f5866ffd640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 0x7f585406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:50.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.872+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f586808bdf0 con 0x7f58700b8f20 2024-04-16T12:55:50.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.872+0000 7f58760a5640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 0x7f585406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:50.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.873+0000 7f58760a5640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 0x7f585406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f586c034000 tx=0x7f586c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:50.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:50.877+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5868059e20 con 0x7f58700b8f20 2024-04-16T12:55:51.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.061+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f58700d21e0 con 0x7f58700b8f20 2024-04-16T12:55:51.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.061+0000 7f5866ffd640 1 -- 172.21.15.18:0/3949121155 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f5868059720 con 0x7f58700b8f20 2024-04-16T12:55:51.064 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 msgr2=0x7f585406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 0x7f585406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f586c034000 tx=0x7f586c009030 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 msgr2=0x7f58700cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58700ba4c0 tx=0x7f5868011cf0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 shutdown_connections 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f585406c8f0 0x7f585406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58700b8f20 0x7f58700cdb50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f587015e230 0x7f58700addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 --2- 172.21.15.18:0/3949121155 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f585c0039b0 0x7f5870150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 >> 172.21.15.18:0/3949121155 conn(0x7f58700d48b0 msgr2=0x7f58700cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 shutdown_connections 2024-04-16T12:55:51.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.063+0000 7f5878309640 1 -- 172.21.15.18:0/3949121155 wait complete. 2024-04-16T12:55:51.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.179+0000 7faa32a4e640 1 Processor -- start 2024-04-16T12:55:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa32a4e640 1 -- start start 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa32a4e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa2c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa32a4e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2c160480 con 0x7faa2c0b2530 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa32a4e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2c0aedd0 con 0x7faa2c0ced20 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa32a4e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c0b3c00 con 0x7faa2c0b15d0 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa30feb640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa2c0b2530 0x7faa2c0af8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55202/0 (socket says 172.21.15.18:55202) 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.180+0000 7faa30feb640 1 -- 172.21.15.18:0/3060106675 learned_addr learned my addr 172.21.15.18:0/3060106675 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa2c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672810290 0 0) 0x7faa2c160480 con 0x7faa2c0b2530 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa14003520 con 0x7faa2c0b2530 2024-04-16T12:55:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3907398280 0 0) 0x7faa14003520 con 0x7faa2c0b2530 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 msgr2=0x7faa2c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa2c0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 >> v1:172.21.15.104:6789/0 conn(0x7faa2c0ced20 legacy=0x7faa2c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c0b3ee0 con 0x7faa2c0b2530 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7faa240019f0 con 0x7faa2c0b2530 2024-04-16T12:55:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 >> v1:172.21.15.18:6789/0 conn(0x7faa2c0b2530 legacy=0x7faa2c0af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa140039e0 0x7faa14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14004800 0x7faa14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0b3c00 con 0x7faa14004800 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faa1400bb00 con 0x7faa140039e0 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7faa1400bd00 con 0x7faa2c0b15d0 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14004800 0x7faa14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2bfff640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa140039e0 0x7faa14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa30feb640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 -- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 msgr2=0x7faa140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c0b15d0 0x7faa140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 -- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa140039e0 msgr2=0x7faa14003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa140039e0 0x7faa14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.181+0000 7faa2b7fe640 1 -- 172.21.15.18:0/3060106675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa14003520 con 0x7faa14004800 2024-04-16T12:55:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.182+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14004800 0x7faa14004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0b19f0 tx=0x7faa14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc3e7fd4e592032 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.182+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20039070 con 0x7faa14004800 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.182+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2002c630 con 0x7faa14004800 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.182+0000 7faa2affd640 1 -- 172.21.15.18:0/3060106675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20009690 con 0x7faa14004800 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 -- 172.21.15.18:0/3060106675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14004800 msgr2=0x7faa14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 --2- 172.21.15.18:0/3060106675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa14004800 0x7faa14004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0b19f0 tx=0x7faa14005830 comp rx=0 tx=0).stop 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa30feb640 1 -- 172.21.15.18:0/3060106675 reap_dead start 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 -- 172.21.15.18:0/3060106675 shutdown_connections 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 -- 172.21.15.18:0/3060106675 >> 172.21.15.18:0/3060106675 conn(0x7faa2c09aa10 msgr2=0x7faa2c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 -- 172.21.15.18:0/3060106675 shutdown_connections 2024-04-16T12:55:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.183+0000 7faa32a4e640 1 -- 172.21.15.18:0/3060106675 wait complete. 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.184+0000 7faa32a4e640 1 Processor -- start 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.184+0000 7faa32a4e640 1 -- start start 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa2c14c9a0 0x7faa2c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c06cb40 0x7faa2c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0b39a0 con 0x7faa2c0cae10 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0b3820 con 0x7faa2c14c9a0 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa32a4e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c0b0f80 con 0x7faa2c06cb40 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59410/0 (socket says 172.21.15.18:59410) 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 -- 172.21.15.18:0/2345321743 learned_addr learned my addr 172.21.15.18:0/2345321743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 -- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c06cb40 msgr2=0x7faa2c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c06cb40 0x7faa2c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 -- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa2c14c9a0 msgr2=0x7faa2c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa2c14c9a0 0x7faa2c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.185+0000 7faa2b7fe640 1 -- 172.21.15.18:0/2345321743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c15a0d0 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa2b7fe640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa20000c00 tx=0x7faa20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20042020 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2003a040 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20039070 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c15a370 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.186+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c15a930 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.187+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2c068a70 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.187+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa20045020 con 0x7faa2c0cae10 2024-04-16T12:55:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.188+0000 7faa28ff9640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 0x7faa1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.188+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faa200ad2e0 con 0x7faa2c0cae10 2024-04-16T12:55:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.188+0000 7faa2bfff640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 0x7faa1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.188+0000 7faa2bfff640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 0x7faa1806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0016d0 tx=0x7faa1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.192+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa2004c070 con 0x7faa2c0cae10 2024-04-16T12:55:51.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.378+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa2c0ae870 con 0x7faa2c0cae10 2024-04-16T12:55:51.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.380+0000 7faa28ff9640 1 -- 172.21.15.18:0/2345321743 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7faa2007b300 con 0x7faa2c0cae10 2024-04-16T12:55:51.382 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:51.383 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:51.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.381+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 msgr2=0x7faa1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.381+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 0x7faa1806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0016d0 tx=0x7faa1c009040 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.381+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 msgr2=0x7faa2c159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.381+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa20000c00 tx=0x7faa20004730 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 shutdown_connections 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faa1806c920 0x7faa1806ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7faa2c06cb40 0x7faa2c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa2c0cae10 0x7faa2c159b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 --2- 172.21.15.18:0/2345321743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faa2c14c9a0 0x7faa2c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 >> 172.21.15.18:0/2345321743 conn(0x7faa2c09aa10 msgr2=0x7faa2c15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 shutdown_connections 2024-04-16T12:55:51.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.382+0000 7faa32a4e640 1 -- 172.21.15.18:0/2345321743 wait complete. 2024-04-16T12:55:51.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:51.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.501+0000 7fb82fdf4640 1 Processor -- start 2024-04-16T12:55:51.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 -- start start 2024-04-16T12:55:51.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8280cd170 0x7fb82815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280b4100 0x7fb8280b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82815d5f0 con 0x7fb8280cd550 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb8280b4ab0 con 0x7fb8280cd170 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.502+0000 7fb82fdf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb82815d390 con 0x7fb8280b4100 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82db90640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8280cd170 0x7fb82815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82d38f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb8280cd550 0x7fb828160b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55218/0 (socket says 172.21.15.18:55218) 2024-04-16T12:55:51.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82d38f640 1 -- 172.21.15.18:0/1052577015 learned_addr learned my addr 172.21.15.18:0/1052577015 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:51.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82e391640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280b4100 0x7fb8280b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82db90640 1 -- 172.21.15.18:0/1052577015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280b4100 msgr2=0x7fb8280b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82db90640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280b4100 0x7fb8280b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82db90640 1 -- 172.21.15.18:0/1052577015 >> v1:172.21.15.18:6789/0 conn(0x7fb8280cd550 legacy=0x7fb828160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82cb8e640 1 -- 172.21.15.18:0/1052577015 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236402079 0 0) 0x7fb82815d5f0 con 0x7fb8280cd550 2024-04-16T12:55:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.503+0000 7fb82db90640 1 -- 172.21.15.18:0/1052577015 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82815d8d0 con 0x7fb8280cd170 2024-04-16T12:55:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82db90640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cd170 0x7fb82815ce50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097d0 tx=0x7fb82402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99f0339c6a10c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82cb8e640 1 -- 172.21.15.18:0/1052577015 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824035020 con 0x7fb8280cd170 2024-04-16T12:55:51.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82cb8e640 1 -- 172.21.15.18:0/1052577015 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb824031800 con 0x7fb8280cd170 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82cb8e640 1 -- 172.21.15.18:0/1052577015 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824031bd0 con 0x7fb8280cd170 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1052577015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cd170 msgr2=0x7fb82815ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cd170 0x7fb82815ce50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097d0 tx=0x7fb82402b8a0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1052577015 shutdown_connections 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280b4100 0x7fb8280b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1052577015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cd170 0x7fb82815ce50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1052577015 >> 172.21.15.18:0/1052577015 conn(0x7fb8280cf100 msgr2=0x7fb8280cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.504+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1052577015 shutdown_connections 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.505+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1052577015 wait complete. 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 Processor -- start 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 -- start start 2024-04-16T12:55:51.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280cd170 0x7fb8280c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8280cd550 0x7fb828154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8280cda00 con 0x7fb8280b4100 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb828160650 con 0x7fb8280cd550 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82fdf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb828161260 con 0x7fb8280cd170 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82db90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82db90640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59430/0 (socket says 172.21.15.18:59430) 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.506+0000 7fb82db90640 1 -- 172.21.15.18:0/1711838695 learned_addr learned my addr 172.21.15.18:0/1711838695 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:51.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82e391640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8280cd550 0x7fb828154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82d38f640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280cd170 0x7fb8280c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 -- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280cd170 msgr2=0x7fb8280c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280cd170 0x7fb8280c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 -- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8280cd550 msgr2=0x7fb828154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8280cd550 0x7fb828154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 -- 172.21.15.18:0/1711838695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8280ca4f0 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82db90640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8240098f0 tx=0x7fb8240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824041070 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82403ad00 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8280ca7d0 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824035040 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.507+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8280cad90 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.508+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb828068a70 con 0x7fb8280b4100 2024-04-16T12:55:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.509+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb82404c060 con 0x7fb8280b4100 2024-04-16T12:55:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.509+0000 7fb81e7fc640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.509+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb8240ada60 con 0x7fb8280b4100 2024-04-16T12:55:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.509+0000 7fb82d38f640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.510+0000 7fb82d38f640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 0x7fb80c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b40d0 tx=0x7fb818009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.513+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb82407bb20 con 0x7fb8280b4100 2024-04-16T12:55:51.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.701+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb8280cfee0 con 0x7fb8280b4100 2024-04-16T12:55:51.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.701+0000 7fb81e7fc640 1 -- 172.21.15.18:0/1711838695 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fb82407b420 con 0x7fb8280b4100 2024-04-16T12:55:51.704 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:51.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 msgr2=0x7fb80c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 0x7fb80c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b40d0 tx=0x7fb818009040 comp rx=0 tx=0).stop 2024-04-16T12:55:51.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 msgr2=0x7fb8280b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8240098f0 tx=0x7fb8240046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 shutdown_connections 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8280cd550 0x7fb828154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb8280cd170 0x7fb8280c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 --2- 172.21.15.18:0/1711838695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280b4100 0x7fb8280b6440 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.703+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 >> 172.21.15.18:0/1711838695 conn(0x7fb8280cf100 msgr2=0x7fb8280d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.704+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 shutdown_connections 2024-04-16T12:55:51.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.704+0000 7fb82fdf4640 1 -- 172.21.15.18:0/1711838695 wait complete. 2024-04-16T12:55:51.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:51.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.821+0000 7fa59ecd3640 1 Processor -- start 2024-04-16T12:55:51.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.821+0000 7fa59ecd3640 1 -- start start 2024-04-16T12:55:51.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59ecd3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5980b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59ecd3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa59806e2c0 0x7fa5980b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59ecd3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5980ce2a0 con 0x7fa5980b2640 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59ecd3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa5980ce580 con 0x7fa59806e2c0 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59ecd3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa5980ce860 con 0x7fa59806dee0 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59d270640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa5980b2640 0x7fa5980d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55222/0 (socket says 172.21.15.18:55222) 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.822+0000 7fa59d270640 1 -- 172.21.15.18:0/542453817 learned_addr learned my addr 172.21.15.18:0/542453817 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 --2- 172.21.15.18:0/542453817 >> v2:172.21.15.104:3300/0 conn(0x7fa59806e2c0 0x7fa5980b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa59ca6f640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5980b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561069832 0 0) 0x7fa5980ce2a0 con 0x7fa5980b2640 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa584003520 con 0x7fa5980b2640 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2518488034 0 0) 0x7fa584003520 con 0x7fa5980b2640 2024-04-16T12:55:51.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 msgr2=0x7fa5980b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5980b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 >> v2:172.21.15.104:3300/0 conn(0x7fa59806e2c0 msgr2=0x7fa5980b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 --2- 172.21.15.18:0/542453817 >> v2:172.21.15.104:3300/0 conn(0x7fa59806e2c0 0x7fa5980b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5980ceb40 con 0x7fa5980b2640 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fa5880019f0 con 0x7fa5980b2640 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 >> v1:172.21.15.18:6789/0 conn(0x7fa5980b2640 legacy=0x7fa5980d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5840039b0 0x7fa584003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584004800 0x7fa584004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980ce580 con 0x7fa584004800 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980ce860 con 0x7fa5840039b0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa58400b9c0 con 0x7fa59806dee0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584004800 0x7fa584004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa59ca6f640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5840039b0 0x7fa584003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa59d270640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 -- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 msgr2=0x7fa5840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa59806dee0 0x7fa5840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 -- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5840039b0 msgr2=0x7fa584003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5840039b0 0x7fa584003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.823+0000 7fa597fff640 1 -- 172.21.15.18:0/542453817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa584003520 con 0x7fa584004800 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.824+0000 7fa597fff640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584004800 0x7fa584004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa580009a90 tx=0x7fa584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7264a9e296d538 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.824+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580039070 con 0x7fa584004800 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.824+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58002c6b0 con 0x7fa584004800 2024-04-16T12:55:51.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.824+0000 7fa5977fe640 1 -- 172.21.15.18:0/542453817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580009690 con 0x7fa584004800 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 -- 172.21.15.18:0/542453817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584004800 msgr2=0x7fa584004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/542453817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa584004800 0x7fa584004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa580009a90 tx=0x7fa584005830 comp rx=0 tx=0).stop 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59d270640 1 -- 172.21.15.18:0/542453817 reap_dead start 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 -- 172.21.15.18:0/542453817 shutdown_connections 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 -- 172.21.15.18:0/542453817 >> 172.21.15.18:0/542453817 conn(0x7fa59809aa10 msgr2=0x7fa5980b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 -- 172.21.15.18:0/542453817 shutdown_connections 2024-04-16T12:55:51.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.825+0000 7fa59ecd3640 1 -- 172.21.15.18:0/542453817 wait complete. 2024-04-16T12:55:51.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.826+0000 7fa59ecd3640 1 Processor -- start 2024-04-16T12:55:51.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.826+0000 7fa59ecd3640 1 -- start start 2024-04-16T12:55:51.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa584004800 0x7fa598160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa59815f370 0x7fa5980b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980cdfb0 con 0x7fa5980b6760 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980cde30 con 0x7fa59815f370 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ecd3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fa5980b1b30 con 0x7fa584004800 2024-04-16T12:55:51.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59452/0 (socket says 172.21.15.18:59452) 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 -- 172.21.15.18:0/745909988 learned_addr learned my addr 172.21.15.18:0/745909988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59ca6f640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa584004800 0x7fa598160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa597fff640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa59815f370 0x7fa5980b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 -- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa584004800 msgr2=0x7fa598160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa584004800 0x7fa598160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 -- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa59815f370 msgr2=0x7fa5980b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa59815f370 0x7fa5980b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:51.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.827+0000 7fa59d270640 1 -- 172.21.15.18:0/745909988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa598160ad0 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa59d270640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa588002230 tx=0x7fa58800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58800ec10 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588018070 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5981f4610 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588013420 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.828+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5981f4bd0 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.829+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa598068a70 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.829+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5880135c0 con 0x7fa5980b6760 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.830+0000 7fa5957fa640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:51.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.830+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa58808c040 con 0x7fa5980b6760 2024-04-16T12:55:51.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.830+0000 7fa59ca6f640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:51.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.830+0000 7fa59ca6f640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 0x7fa57806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa590009ae0 tx=0x7fa590009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:51.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:51.834+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa598160ad0 con 0x7fa5980b6760 2024-04-16T12:55:52.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.019+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa5980b70d0 con 0x7fa5980b6760 2024-04-16T12:55:52.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.019+0000 7fa5957fa640 1 -- 172.21.15.18:0/745909988 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fa58805a100 con 0x7fa5980b6760 2024-04-16T12:55:52.022 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.021+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 msgr2=0x7fa57806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.021+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 0x7fa57806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa590009ae0 tx=0x7fa590009190 comp rx=0 tx=0).stop 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.021+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 msgr2=0x7fa5980af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.021+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa588002230 tx=0x7fa58800e530 comp rx=0 tx=0).stop 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 shutdown_connections 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fa57806c920 0x7fa57806ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5980b6760 0x7fa5980af440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa59815f370 0x7fa5980b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 --2- 172.21.15.18:0/745909988 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fa584004800 0x7fa598160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 >> 172.21.15.18:0/745909988 conn(0x7fa59809aa10 msgr2=0x7fa59815e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 shutdown_connections 2024-04-16T12:55:52.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.022+0000 7fa59ecd3640 1 -- 172.21.15.18:0/745909988 wait complete. 2024-04-16T12:55:52.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.140+0000 7f24425d4640 1 Processor -- start 2024-04-16T12:55:52.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.140+0000 7f24425d4640 1 -- start start 2024-04-16T12:55:52.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f243c06ce10 0x7f243c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f243c0d2ce0 0x7f243c0d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0cf1c0 0x7f243c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f243c15f0a0 con 0x7f243c0d2ce0 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f243c0d37a0 con 0x7f243c06ce10 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f24425d4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f243c0d3a80 con 0x7f243c0cf1c0 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f243c0d2ce0 0x7f243c0d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f243c0d2ce0 0x7f243c0d3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59454/0 (socket says 172.21.15.18:59454) 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 -- 172.21.15.18:0/4211031688 learned_addr learned my addr 172.21.15.18:0/4211031688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243bfff640 1 --2- 172.21.15.18:0/4211031688 >> v2:172.21.15.104:3300/0 conn(0x7f243c06ce10 0x7f243c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f2440b71640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0cf1c0 0x7f243c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 -- 172.21.15.18:0/4211031688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0cf1c0 msgr2=0x7f243c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0cf1c0 0x7f243c0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 -- 172.21.15.18:0/4211031688 >> v2:172.21.15.104:3300/0 conn(0x7f243c06ce10 msgr2=0x7f243c06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 --2- 172.21.15.18:0/4211031688 >> v2:172.21.15.104:3300/0 conn(0x7f243c06ce10 0x7f243c06d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.141+0000 7f243b7fe640 1 -- 172.21.15.18:0/4211031688 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0d3d60 con 0x7f243c0d2ce0 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f243b7fe640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c0d2ce0 0x7f243c0d3150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f243c0b7520 tx=0x7f243002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbd6ee41c82645b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f243affd640 1 -- 172.21.15.18:0/4211031688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430034070 con 0x7f243c0d2ce0 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f243affd640 1 -- 172.21.15.18:0/4211031688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430030860 con 0x7f243c0d2ce0 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f243affd640 1 -- 172.21.15.18:0/4211031688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430030c30 con 0x7f243c0d2ce0 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 -- 172.21.15.18:0/4211031688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c0d2ce0 msgr2=0x7f243c0d3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c0d2ce0 0x7f243c0d3150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f243c0b7520 tx=0x7f243002b9a0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 -- 172.21.15.18:0/4211031688 shutdown_connections 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0cf1c0 0x7f243c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 --2- 172.21.15.18:0/4211031688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c0d2ce0 0x7f243c0d3150 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 --2- 172.21.15.18:0/4211031688 >> v2:172.21.15.104:3300/0 conn(0x7f243c06ce10 0x7f243c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.142+0000 7f24425d4640 1 -- 172.21.15.18:0/4211031688 >> 172.21.15.18:0/4211031688 conn(0x7f243c0d48d0 msgr2=0x7f243c0d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.143+0000 7f24425d4640 1 -- 172.21.15.18:0/4211031688 shutdown_connections 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.143+0000 7f24425d4640 1 -- 172.21.15.18:0/4211031688 wait complete. 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.144+0000 7f24425d4640 1 Processor -- start 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.144+0000 7f24425d4640 1 -- start start 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 0x7f243c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0d2ce0 0x7f243c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f243c06d730 con 0x7f243c06ce10 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f243c0d4320 con 0x7f243c0cf1c0 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f243c06bc20 con 0x7f243c0d2ce0 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59458/0 (socket says 172.21.15.18:59458) 2024-04-16T12:55:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 -- 172.21.15.18:0/2925545641 learned_addr learned my addr 172.21.15.18:0/2925545641 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f2440b71640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0d2ce0 0x7f243c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243b7fe640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 0x7f243c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 -- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0d2ce0 msgr2=0x7f243c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0d2ce0 0x7f243c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 -- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 msgr2=0x7f243c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 0x7f243c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 -- 172.21.15.18:0/2925545641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c1515f0 con 0x7f243c06ce10 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243b7fe640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 0x7f243c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f243bfff640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f242c00d800 tx=0x7f242c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c018020 con 0x7f243c06ce10 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c0096a0 con 0x7f243c06ce10 2024-04-16T12:55:52.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c009a70 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.145+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c1518d0 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.146+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c151e90 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.146+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c0752b0 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.147+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f242c01b020 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.147+0000 7f2438ff9640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 0x7f242806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.148+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f242c08c4a0 con 0x7f243c06ce10 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.148+0000 7f243b7fe640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 0x7f242806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.148+0000 7f243b7fe640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 0x7f242806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2430036000 tx=0x7f243003b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.152+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f242c022020 con 0x7f243c06ce10 2024-04-16T12:55:52.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.339+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f243c0d29e0 con 0x7f243c06ce10 2024-04-16T12:55:52.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.339+0000 7f2438ff9640 1 -- 172.21.15.18:0/2925545641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f242c05a4d0 con 0x7f243c06ce10 2024-04-16T12:55:52.342 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 msgr2=0x7f242806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 0x7f242806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2430036000 tx=0x7f243003b040 comp rx=0 tx=0).stop 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 msgr2=0x7f243c150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f242c00d800 tx=0x7f242c00dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 shutdown_connections 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f242806c8f0 0x7f242806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f243c0d2ce0 0x7f243c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f243c0cf1c0 0x7f243c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 --2- 172.21.15.18:0/2925545641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243c06ce10 0x7f243c150d10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 >> 172.21.15.18:0/2925545641 conn(0x7f243c0d48d0 msgr2=0x7f243c0c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 shutdown_connections 2024-04-16T12:55:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.341+0000 7f24425d4640 1 -- 172.21.15.18:0/2925545641 wait complete. 2024-04-16T12:55:52.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.459+0000 7f2eac4df640 1 Processor -- start 2024-04-16T12:55:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.459+0000 7f2eac4df640 1 -- start start 2024-04-16T12:55:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eac4df640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ea415eca0 0x7f2ea406c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eac4df640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2ea406d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eac4df640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea40d2d90 con 0x7f2ea40b37e0 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eac4df640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea415f080 con 0x7f2ea415eca0 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eac4df640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea406d7a0 con 0x7f2ea406ce10 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2ea9a7a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2ea40b37e0 0x7f2ea40d3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55224/0 (socket says 172.21.15.18:55224) 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2ea9a7a640 1 -- 172.21.15.18:0/3825280104 learned_addr learned my addr 172.21.15.18:0/3825280104 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eaa27b640 1 --2- 172.21.15.18:0/3825280104 >> v2:172.21.15.104:3300/0 conn(0x7f2ea415eca0 0x7f2ea406c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2ea406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774281582 0 0) 0x7f2ea40d2d90 con 0x7f2ea40b37e0 2024-04-16T12:55:52.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.460+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c003520 con 0x7f2ea40b37e0 2024-04-16T12:55:52.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 68560898 0 0) 0x7f2e8c003520 con 0x7f2ea40b37e0 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 msgr2=0x7f2ea406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2ea406d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 >> v2:172.21.15.104:3300/0 conn(0x7f2ea415eca0 msgr2=0x7f2ea406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 --2- 172.21.15.18:0/3825280104 >> v2:172.21.15.104:3300/0 conn(0x7f2ea415eca0 0x7f2ea406c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea40d3070 con 0x7f2ea40b37e0 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f2e98001670 con 0x7f2ea40b37e0 2024-04-16T12:55:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 >> v1:172.21.15.18:6789/0 conn(0x7f2ea40b37e0 legacy=0x7f2ea40d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2e8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea415f080 con 0x7f2e8c004d40 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea406d7a0 con 0x7f2e8c0039b0 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c00b9c0 con 0x7f2ea406ce10 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaa27b640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2ea9a7a640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2e8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 -- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 msgr2=0x7f2e8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea406ce10 0x7f2e8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 -- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8c0039b0 msgr2=0x7f2e8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e8c0039b0 0x7f2e8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.461+0000 7f2eaaa7c640 1 -- 172.21.15.18:0/3825280104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c003520 con 0x7f2e8c004d40 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.462+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2e8c0051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009fc0 tx=0x7f2e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd05d0b11d9932d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.462+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94039070 con 0x7f2e8c004d40 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.462+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9402cc20 con 0x7f2e8c004d40 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.462+0000 7f2ea9279640 1 -- 172.21.15.18:0/3825280104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94009c10 con 0x7f2e8c004d40 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 -- 172.21.15.18:0/3825280104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 msgr2=0x7f2e8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 --2- 172.21.15.18:0/3825280104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2e8c0051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009fc0 tx=0x7f2e8c005830 comp rx=0 tx=0).stop 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eaaa7c640 1 -- 172.21.15.18:0/3825280104 reap_dead start 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 -- 172.21.15.18:0/3825280104 shutdown_connections 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 -- 172.21.15.18:0/3825280104 >> 172.21.15.18:0/3825280104 conn(0x7f2ea40d48b0 msgr2=0x7f2ea40d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 -- 172.21.15.18:0/3825280104 shutdown_connections 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.463+0000 7f2eac4df640 1 -- 172.21.15.18:0/3825280104 wait complete. 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.464+0000 7f2eac4df640 1 Processor -- start 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.464+0000 7f2eac4df640 1 -- start start 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 0x7f2ea4161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 0x7f2ea40ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea40d3910 con 0x7f2e8c004d40 2024-04-16T12:55:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea40d3630 con 0x7f2ea4161210 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eac4df640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea406c970 con 0x7f2ea40ab3f0 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59468/0 (socket says 172.21.15.18:59468) 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 -- 172.21.15.18:0/290104393 learned_addr learned my addr 172.21.15.18:0/290104393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2ea9a7a640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 0x7f2ea4161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 0x7f2ea40ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 -- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 msgr2=0x7f2ea40ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 0x7f2ea40ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 -- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 msgr2=0x7f2ea4161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 0x7f2ea4161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 -- 172.21.15.18:0/290104393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea40afbe0 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaaa7c640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 0x7f2ea40ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2ea9a7a640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 0x7f2ea4161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2eaa27b640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0119c0 tx=0x7f2e9c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.465+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00fb50 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.466+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c00fcf0 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.466+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea40ac160 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.466+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00fea0 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.466+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea40ac720 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.467+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea4161bd0 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.467+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e9c012040 con 0x7f2e8c004d40 2024-04-16T12:55:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.467+0000 7f2ea2ffd640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 0x7f2e9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.467+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2e9c08c530 con 0x7f2e8c004d40 2024-04-16T12:55:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.468+0000 7f2ea9a7a640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 0x7f2e9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.468+0000 7f2ea9a7a640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 0x7f2e9006ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40cf570 tx=0x7f2e98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.472+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e9c019030 con 0x7f2e8c004d40 2024-04-16T12:55:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.659+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2ea40752b0 con 0x7f2e8c004d40 2024-04-16T12:55:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.659+0000 7f2ea2ffd640 1 -- 172.21.15.18:0/290104393 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2e9c05a5f0 con 0x7f2e8c004d40 2024-04-16T12:55:52.662 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 msgr2=0x7f2e9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 0x7f2e9006ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40cf570 tx=0x7f2e98009040 comp rx=0 tx=0).stop 2024-04-16T12:55:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 msgr2=0x7f2ea415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0119c0 tx=0x7f2e9c011e80 comp rx=0 tx=0).stop 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 shutdown_connections 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e9006c920 0x7f2e9006ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2ea40ab3f0 0x7f2ea40ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ea4161210 0x7f2ea4161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 --2- 172.21.15.18:0/290104393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e8c004d40 0x7f2ea415ca60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 >> 172.21.15.18:0/290104393 conn(0x7f2ea40d48b0 msgr2=0x7f2ea40b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 shutdown_connections 2024-04-16T12:55:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.661+0000 7f2eac4df640 1 -- 172.21.15.18:0/290104393 wait complete. 2024-04-16T12:55:52.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.777+0000 7f12463bd640 1 Processor -- start 2024-04-16T12:55:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.777+0000 7f12463bd640 1 -- start start 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f12463bd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f124009aa10 0x7f124009b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f12463bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12400d0690 0x7f12400d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f12463bd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1240162300 con 0x7f124009bc20 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f12463bd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f12400c9520 con 0x7f124009aa10 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f12463bd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1240071d80 con 0x7f12400d0690 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f124009aa10 0x7f124009b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f124009aa10 0x7f124009b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59470/0 (socket says 172.21.15.18:59470) 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 -- 172.21.15.18:0/4155688198 learned_addr learned my addr 172.21.15.18:0/4155688198 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:52.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f124495a640 1 --2- 172.21.15.18:0/4155688198 >> v2:172.21.15.104:3300/0 conn(0x7f12400d0690 0x7f12400d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 -- 172.21.15.18:0/4155688198 >> v2:172.21.15.104:3300/0 conn(0x7f12400d0690 msgr2=0x7f12400d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 --2- 172.21.15.18:0/4155688198 >> v2:172.21.15.104:3300/0 conn(0x7f12400d0690 0x7f12400d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 -- 172.21.15.18:0/4155688198 >> v1:172.21.15.104:6789/0 conn(0x7f124009bc20 legacy=0x7f124009adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:52.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.778+0000 7f123ffff640 1 -- 172.21.15.18:0/4155688198 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1240072060 con 0x7f124009aa10 2024-04-16T12:55:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.779+0000 7f123ffff640 1 --2- 172.21.15.18:0/4155688198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124009b660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1240073d70 tx=0x7f123002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b1eb225ac26178 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.779+0000 7f123effd640 1 -- 172.21.15.18:0/4155688198 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230035020 con 0x7f124009aa10 2024-04-16T12:55:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.779+0000 7f123effd640 1 -- 172.21.15.18:0/4155688198 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1230031870 con 0x7f124009aa10 2024-04-16T12:55:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.779+0000 7f123effd640 1 -- 172.21.15.18:0/4155688198 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230031c40 con 0x7f124009aa10 2024-04-16T12:55:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 -- 172.21.15.18:0/4155688198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 msgr2=0x7f124009b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 --2- 172.21.15.18:0/4155688198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124009b660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1240073d70 tx=0x7f123002b910 comp rx=0 tx=0).stop 2024-04-16T12:55:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 -- 172.21.15.18:0/4155688198 shutdown_connections 2024-04-16T12:55:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 --2- 172.21.15.18:0/4155688198 >> v2:172.21.15.104:3300/0 conn(0x7f12400d0690 0x7f12400d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 --2- 172.21.15.18:0/4155688198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124009b660 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 -- 172.21.15.18:0/4155688198 >> 172.21.15.18:0/4155688198 conn(0x7f12400d2600 msgr2=0x7f12400d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 -- 172.21.15.18:0/4155688198 shutdown_connections 2024-04-16T12:55:52.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.780+0000 7f12463bd640 1 -- 172.21.15.18:0/4155688198 wait complete. 2024-04-16T12:55:52.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.781+0000 7f12463bd640 1 Processor -- start 2024-04-16T12:55:52.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.781+0000 7f12463bd640 1 -- start start 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f124009bc20 0x7f12400b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12400d0690 0x7f12400b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f124006dba0 con 0x7f124009aa10 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f124006d8c0 con 0x7f124009bc20 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f12463bd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1240071a30 con 0x7f12400d0690 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59482/0 (socket says 172.21.15.18:59482) 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 -- 172.21.15.18:0/3226915844 learned_addr learned my addr 172.21.15.18:0/3226915844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 -- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12400d0690 msgr2=0x7f12400b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12400d0690 0x7f12400b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 -- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f124009bc20 msgr2=0x7f12400b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f124009bc20 0x7f12400b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.782+0000 7f123ffff640 1 -- 172.21.15.18:0/3226915844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124014b360 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f123ffff640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f12300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230040070 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123003a420 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230035040 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12401e92c0 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.783+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12401e9880 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.784+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12400752b0 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.784+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1230038020 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.785+0000 7f123cff9640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 0x7f122c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.785+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f12300adfb0 con 0x7f124009aa10 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.785+0000 7f123f7fe640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 0x7f122c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:52.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.785+0000 7f123f7fe640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 0x7f122c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1234006fd0 tx=0x7f1234006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:52.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.789+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f123007bf50 con 0x7f124009aa10 2024-04-16T12:55:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.977+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12400d3360 con 0x7f124009aa10 2024-04-16T12:55:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.980+0000 7f123cff9640 1 -- 172.21.15.18:0/3226915844 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f123007b850 con 0x7f124009aa10 2024-04-16T12:55:52.982 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:52.983 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 msgr2=0x7f122c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 0x7f122c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1234006fd0 tx=0x7f1234006bc0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 msgr2=0x7f124014a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f12300046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 shutdown_connections 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f122c06c8f0 0x7f122c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f12400d0690 0x7f12400b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f124009bc20 0x7f12400b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 --2- 172.21.15.18:0/3226915844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f124009aa10 0x7f124014a990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 >> 172.21.15.18:0/3226915844 conn(0x7f12400d2600 msgr2=0x7f12400d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 shutdown_connections 2024-04-16T12:55:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:52.982+0000 7f12463bd640 1 -- 172.21.15.18:0/3226915844 wait complete. 2024-04-16T12:55:52.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:52.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:53.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.101+0000 7f8a66e4a640 1 Processor -- start 2024-04-16T12:55:53.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.101+0000 7f8a66e4a640 1 -- start start 2024-04-16T12:55:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a66e4a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a60162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a66e4a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600b7a60 con 0x7f8a600ba350 2024-04-16T12:55:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a5ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8a600ba350 0x7f8a600cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55236/0 (socket says 172.21.15.18:55236) 2024-04-16T12:55:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6015ef40 con 0x7f8a600cfca0 2024-04-16T12:55:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a5ffff640 1 -- 172.21.15.18:0/1046991688 learned_addr learned my addr 172.21.15.18:0/1046991688 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600d2f30 con 0x7f8a6015eb60 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a64be6640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a60162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512463580 0 0) 0x7f8a54001110 con 0x7f8a600ba350 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.102+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a48003520 con 0x7f8a600ba350 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3185609513 0 0) 0x7f8a48003520 con 0x7f8a600ba350 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 msgr2=0x7f8a60162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a60162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 >> v1:172.21.15.104:6789/0 conn(0x7f8a600cfca0 legacy=0x7f8a600d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a60162d30 con 0x7f8a600ba350 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f8a54001840 con 0x7f8a600ba350 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 >> v1:172.21.15.18:6789/0 conn(0x7f8a600ba350 legacy=0x7f8a600cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a480039e0 0x7f8a48003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600d2f30 con 0x7f8a48004d40 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4800b9c0 con 0x7f8a480039e0 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4800bbc0 con 0x7f8a6015eb60 2024-04-16T12:55:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a5ffff640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a64be6640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a480039e0 0x7f8a48003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 -- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 msgr2=0x7f8a48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015eb60 0x7f8a48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 -- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a480039e0 msgr2=0x7f8a48003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a480039e0 0x7f8a48003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.103+0000 7f8a653e7640 1 -- 172.21.15.18:0/1046991688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a48003520 con 0x7f8a48004d40 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.104+0000 7f8a653e7640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a50001f60 tx=0x7f8a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bb32201ec48bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.104+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50001b30 con 0x7f8a48004d40 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.104+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5002d710 con 0x7f8a48004d40 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.104+0000 7f8a5f7fe640 1 -- 172.21.15.18:0/1046991688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5002db00 con 0x7f8a48004d40 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a48004d40 msgr2=0x7f8a480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/1046991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a48004d40 0x7f8a480051c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a50001f60 tx=0x7f8a48005830 comp rx=0 tx=0).stop 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a653e7640 1 -- 172.21.15.18:0/1046991688 reap_dead start 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 shutdown_connections 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 >> 172.21.15.18:0/1046991688 conn(0x7f8a600b65b0 msgr2=0x7f8a600b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 shutdown_connections 2024-04-16T12:55:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.105+0000 7f8a66e4a640 1 -- 172.21.15.18:0/1046991688 wait complete. 2024-04-16T12:55:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.106+0000 7f8a66e4a640 1 Processor -- start 2024-04-16T12:55:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.106+0000 7f8a66e4a640 1 -- start start 2024-04-16T12:55:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a48004d40 0x7f8a60160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015f890 0x7f8a6015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600ba7b0 con 0x7f8a601e82e0 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a601632f0 con 0x7f8a48004d40 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a66e4a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8a60162630 con 0x7f8a6015f890 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59498/0 (socket says 172.21.15.18:59498) 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 -- 172.21.15.18:0/3318780541 learned_addr learned my addr 172.21.15.18:0/3318780541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a653e7640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015f890 0x7f8a6015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a64be6640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a48004d40 0x7f8a60160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 -- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015f890 msgr2=0x7f8a6015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015f890 0x7f8a6015fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 -- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a48004d40 msgr2=0x7f8a60160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a48004d40 0x7f8a60160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 -- 172.21.15.18:0/3318780541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600cac10 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5ffff640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8a540072c0 tx=0x7f8a54007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.107+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400f960 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.108+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a54018070 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.108+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a600caeb0 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.108+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400fd80 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.108+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600c8690 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.108+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600752b0 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.109+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a5401d460 con 0x7f8a601e82e0 2024-04-16T12:55:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.109+0000 7f8a5d7fa640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.109+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8a5408bff0 con 0x7f8a601e82e0 2024-04-16T12:55:53.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.110+0000 7f8a64be6640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.110+0000 7f8a64be6640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 0x7f8a4c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009b00 tx=0x7f8a58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.114+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a600b7a60 con 0x7f8a601e82e0 2024-04-16T12:55:53.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.296+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8a600d25d0 con 0x7f8a601e82e0 2024-04-16T12:55:53.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.297+0000 7f8a5d7fa640 1 -- 172.21.15.18:0/3318780541 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8a5405a0b0 con 0x7f8a601e82e0 2024-04-16T12:55:53.302 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 msgr2=0x7f8a4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 0x7f8a4c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009b00 tx=0x7f8a58008040 comp rx=0 tx=0).stop 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 msgr2=0x7f8a6015f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8a540072c0 tx=0x7f8a54007780 comp rx=0 tx=0).stop 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 shutdown_connections 2024-04-16T12:55:53.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8a6015f890 0x7f8a6015fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a601e82e0 0x7f8a6015f350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 --2- 172.21.15.18:0/3318780541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a48004d40 0x7f8a60160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 >> 172.21.15.18:0/3318780541 conn(0x7f8a600b65b0 msgr2=0x7f8a600b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 shutdown_connections 2024-04-16T12:55:53.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.299+0000 7f8a66e4a640 1 -- 172.21.15.18:0/3318780541 wait complete. 2024-04-16T12:55:53.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:53.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 Processor -- start 2024-04-16T12:55:53.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 -- start start 2024-04-16T12:55:53.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 0x7f9b6806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b680ce510 0x7f9b680ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b680cefd0 con 0x7f9b6806ca30 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6806e550 con 0x7f9b680ce510 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.418+0000 7f9b6dba8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6806df00 con 0x7f9b68146160 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b66ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b680ce510 0x7f9b680ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b67fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9b6806ca30 0x7f9b680ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55238/0 (socket says 172.21.15.18:55238) 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b67fff640 1 -- 172.21.15.18:0/2573496151 learned_addr learned my addr 172.21.15.18:0/2573496151 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b677fe640 1 --2- 172.21.15.18:0/2573496151 >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 0x7f9b6806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b66ffd640 1 -- 172.21.15.18:0/2573496151 >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 msgr2=0x7f9b6806e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2573496151 >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 0x7f9b6806e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b66ffd640 1 -- 172.21.15.18:0/2573496151 >> v1:172.21.15.18:6789/0 conn(0x7f9b6806ca30 legacy=0x7f9b680ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b66ffd640 1 -- 172.21.15.18:0/2573496151 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6806e1e0 con 0x7f9b680ce510 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b667fc640 1 -- 172.21.15.18:0/2573496151 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194035090 0 0) 0x7f9b680cefd0 con 0x7f9b6806ca30 2024-04-16T12:55:53.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.419+0000 7f9b677fe640 1 --2- 172.21.15.18:0/2573496151 >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 0x7f9b6806e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2573496151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b680ce510 0x7f9b680ce950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b68073330 tx=0x7f9b5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5a18cb60bbae1c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b667fc640 1 -- 172.21.15.18:0/2573496151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c039070 con 0x7f9b680ce510 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b667fc640 1 -- 172.21.15.18:0/2573496151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5c02cc80 con 0x7f9b680ce510 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b667fc640 1 -- 172.21.15.18:0/2573496151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c034660 con 0x7f9b680ce510 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2573496151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b680ce510 msgr2=0x7f9b680ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2573496151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b680ce510 0x7f9b680ce950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9b68073330 tx=0x7f9b5c02bed0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2573496151 shutdown_connections 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2573496151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b680ce510 0x7f9b680ce950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2573496151 >> v2:172.21.15.104:3300/0 conn(0x7f9b68146160 0x7f9b6806e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.420+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2573496151 >> 172.21.15.18:0/2573496151 conn(0x7f9b68071f70 msgr2=0x7f9b68072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.421+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2573496151 shutdown_connections 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.421+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2573496151 wait complete. 2024-04-16T12:55:53.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.422+0000 7f9b6dba8640 1 Processor -- start 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.422+0000 7f9b6dba8640 1 -- start start 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 0x7f9b6815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b68146160 0x7f9b681f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6806d040 con 0x7f9b6806ca30 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6806cec0 con 0x7f9b680ce510 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6806d1c0 con 0x7f9b68146160 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59514/0 (socket says 172.21.15.18:59514) 2024-04-16T12:55:53.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 -- 172.21.15.18:0/2144651286 learned_addr learned my addr 172.21.15.18:0/2144651286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 0x7f9b6815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b67fff640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b68146160 0x7f9b681f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 -- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b68146160 msgr2=0x7f9b681f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b68146160 0x7f9b681f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 -- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 msgr2=0x7f9b6815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 0x7f9b6815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 -- 172.21.15.18:0/2144651286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6815c4a0 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 0x7f9b6815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b677fe640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800c820 tx=0x7f9b5800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58015070 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b58007a30 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b680ae390 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58007de0 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.423+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b680ae950 con 0x7f9b6806ca30 2024-04-16T12:55:53.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.424+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b680752b0 con 0x7f9b6806ca30 2024-04-16T12:55:53.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.425+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b58018070 con 0x7f9b6806ca30 2024-04-16T12:55:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.425+0000 7f9b4ffff640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 0x7f9b5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.425+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9b5808be60 con 0x7f9b6806ca30 2024-04-16T12:55:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.426+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 0x7f9b5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.426+0000 7f9b66ffd640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 0x7f9b5406ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c036000 tx=0x7f9b5c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.429+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b58059e10 con 0x7f9b6806ca30 2024-04-16T12:55:53.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.612+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9b6806e8e0 con 0x7f9b6806ca30 2024-04-16T12:55:53.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.613+0000 7f9b4ffff640 1 -- 172.21.15.18:0/2144651286 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f9b58059710 con 0x7f9b6806ca30 2024-04-16T12:55:53.615 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 msgr2=0x7f9b5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 0x7f9b5406ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c036000 tx=0x7f9b5c030000 comp rx=0 tx=0).stop 2024-04-16T12:55:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 msgr2=0x7f9b68142b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800c820 tx=0x7f9b5800cce0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 shutdown_connections 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b5406c920 0x7f9b5406ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b68146160 0x7f9b681f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b680ce510 0x7f9b6815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 --2- 172.21.15.18:0/2144651286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b6806ca30 0x7f9b68142b20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 >> 172.21.15.18:0/2144651286 conn(0x7f9b68071f70 msgr2=0x7f9b68072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 shutdown_connections 2024-04-16T12:55:53.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.615+0000 7f9b6dba8640 1 -- 172.21.15.18:0/2144651286 wait complete. 2024-04-16T12:55:53.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 Processor -- start 2024-04-16T12:55:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 -- start start 2024-04-16T12:55:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2504162630 0x7f25040cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25040cfad0 0x7f25040d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25040b7a60 con 0x7f250415eb60 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f25040d2f30 con 0x7f25040cfad0 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.735+0000 7f250a59d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f250415ef40 con 0x7f2504162630 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25040cfad0 0x7f25040d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25040cfad0 0x7f25040d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59494/0 (socket says 172.21.15.18:59494) 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 -- 172.21.15.18:0/1171219568 learned_addr learned my addr 172.21.15.18:0/1171219568 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f25037fe640 1 --2- 172.21.15.18:0/1171219568 >> v2:172.21.15.104:3300/0 conn(0x7f2504162630 0x7f25040cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 -- 172.21.15.18:0/1171219568 >> v2:172.21.15.104:3300/0 conn(0x7f2504162630 msgr2=0x7f25040cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 --2- 172.21.15.18:0/1171219568 >> v2:172.21.15.104:3300/0 conn(0x7f2504162630 0x7f25040cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 -- 172.21.15.18:0/1171219568 >> v1:172.21.15.104:6789/0 conn(0x7f250415eb60 legacy=0x7f25040ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.736+0000 7f2508b3a640 1 -- 172.21.15.18:0/1171219568 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2504162a90 con 0x7f25040cfad0 2024-04-16T12:55:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f2508b3a640 1 --2- 172.21.15.18:0/1171219568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25040cfad0 0x7f25040d33c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f250406e100 tx=0x7f24fc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780b826b971278f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f2502ffd640 1 -- 172.21.15.18:0/1171219568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc02cb20 con 0x7f25040cfad0 2024-04-16T12:55:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f2502ffd640 1 -- 172.21.15.18:0/1171219568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc02ccc0 con 0x7f25040cfad0 2024-04-16T12:55:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f2502ffd640 1 -- 172.21.15.18:0/1171219568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc034610 con 0x7f25040cfad0 2024-04-16T12:55:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 -- 172.21.15.18:0/1171219568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25040cfad0 msgr2=0x7f25040d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 --2- 172.21.15.18:0/1171219568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25040cfad0 0x7f25040d33c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f250406e100 tx=0x7f24fc02bf80 comp rx=0 tx=0).stop 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 -- 172.21.15.18:0/1171219568 shutdown_connections 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 --2- 172.21.15.18:0/1171219568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25040cfad0 0x7f25040d33c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 --2- 172.21.15.18:0/1171219568 >> v2:172.21.15.104:3300/0 conn(0x7f2504162630 0x7f25040cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 -- 172.21.15.18:0/1171219568 >> 172.21.15.18:0/1171219568 conn(0x7f25040b65b0 msgr2=0x7f25040b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 -- 172.21.15.18:0/1171219568 shutdown_connections 2024-04-16T12:55:53.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.737+0000 7f250a59d640 1 -- 172.21.15.18:0/1171219568 wait complete. 2024-04-16T12:55:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.739+0000 7f250a59d640 1 Processor -- start 2024-04-16T12:55:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.739+0000 7f250a59d640 1 -- start start 2024-04-16T12:55:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.739+0000 7f250a59d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25040cfad0 0x7f250415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2504162630 0x7f25041f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25041632f0 con 0x7f250415eb60 2024-04-16T12:55:53.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2504163010 con 0x7f25040cfad0 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f25040d3900 con 0x7f2504162630 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59496/0 (socket says 172.21.15.18:59496) 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 -- 172.21.15.18:0/2613269513 learned_addr learned my addr 172.21.15.18:0/2613269513 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f2503fff640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25040cfad0 0x7f250415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f2508b3a640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2504162630 0x7f25041f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 -- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2504162630 msgr2=0x7f25041f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2504162630 0x7f25041f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 -- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25040cfad0 msgr2=0x7f250415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25040cfad0 0x7f250415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 -- 172.21.15.18:0/2613269513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25040c9dd0 con 0x7f250415eb60 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f25037fe640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24f800e870 tx=0x7f24f800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8017070 con 0x7f250415eb60 2024-04-16T12:55:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25040ca0b0 con 0x7f250415eb60 2024-04-16T12:55:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f800c940 con 0x7f250415eb60 2024-04-16T12:55:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f800cd30 con 0x7f250415eb60 2024-04-16T12:55:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.740+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25040ca670 con 0x7f250415eb60 2024-04-16T12:55:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.741+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25040752b0 con 0x7f250415eb60 2024-04-16T12:55:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.742+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24f801a070 con 0x7f250415eb60 2024-04-16T12:55:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.742+0000 7f2500ff9640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 0x7f24f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.742+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f24f808c1c0 con 0x7f250415eb60 2024-04-16T12:55:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.743+0000 7f2503fff640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 0x7f24f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.743+0000 7f2503fff640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 0x7f24f006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f250415d550 tx=0x7f24f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:53.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.747+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24f8059b10 con 0x7f250415eb60 2024-04-16T12:55:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.932+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25040d54b0 con 0x7f250415eb60 2024-04-16T12:55:53.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.933+0000 7f2500ff9640 1 -- 172.21.15.18:0/2613269513 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f24f805de10 con 0x7f250415eb60 2024-04-16T12:55:53.935 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:53.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 msgr2=0x7f24f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 0x7f24f006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f250415d550 tx=0x7f24f4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 msgr2=0x7f25040ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24f800e870 tx=0x7f24f800ed30 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 shutdown_connections 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f24f006c8f0 0x7f24f006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2504162630 0x7f25041f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250415eb60 0x7f25040ce2d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 --2- 172.21.15.18:0/2613269513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25040cfad0 0x7f250415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 >> 172.21.15.18:0/2613269513 conn(0x7f25040b65b0 msgr2=0x7f25040d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 shutdown_connections 2024-04-16T12:55:53.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:53.935+0000 7f250a59d640 1 -- 172.21.15.18:0/2613269513 wait complete. 2024-04-16T12:55:53.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.054+0000 7f3766a77640 1 Processor -- start 2024-04-16T12:55:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.054+0000 7f3766a77640 1 -- start start 2024-04-16T12:55:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3766a77640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f376006d520 0x7f37600b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3766a77640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3766a77640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376006c410 con 0x7f3760162240 2024-04-16T12:55:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3766a77640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f376006c9a0 con 0x7f376006d520 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3766a77640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f376006c6c0 con 0x7f376006ba20 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f376006d520 0x7f37600b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f376006d520 0x7f37600b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59504/0 (socket says 172.21.15.18:59504) 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 -- 172.21.15.18:0/909034896 learned_addr learned my addr 172.21.15.18:0/909034896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3765014640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 -- 172.21.15.18:0/909034896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 msgr2=0x7f376006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 -- 172.21.15.18:0/909034896 >> v1:172.21.15.104:6789/0 conn(0x7f3760162240 legacy=0x7f376006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.055+0000 7f3757fff640 1 -- 172.21.15.18:0/909034896 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37600d2db0 con 0x7f376006d520 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.056+0000 7f3757fff640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600b7b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3750009870 tx=0x7f375002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ea764eae50fb0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.056+0000 7f37577fe640 1 -- 172.21.15.18:0/909034896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500317c0 con 0x7f376006d520 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.056+0000 7f37577fe640 1 -- 172.21.15.18:0/909034896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750037070 con 0x7f376006d520 2024-04-16T12:55:54.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.056+0000 7f37577fe640 1 -- 172.21.15.18:0/909034896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750031b80 con 0x7f376006d520 2024-04-16T12:55:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 -- 172.21.15.18:0/909034896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 msgr2=0x7f37600b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600b7b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3750009870 tx=0x7f375002b860 comp rx=0 tx=0).stop 2024-04-16T12:55:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 -- 172.21.15.18:0/909034896 shutdown_connections 2024-04-16T12:55:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 --2- 172.21.15.18:0/909034896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600b7b00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 -- 172.21.15.18:0/909034896 >> 172.21.15.18:0/909034896 conn(0x7f37600d48b0 msgr2=0x7f37600d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 -- 172.21.15.18:0/909034896 shutdown_connections 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.057+0000 7f3766a77640 1 -- 172.21.15.18:0/909034896 wait complete. 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.058+0000 7f3766a77640 1 Processor -- start 2024-04-16T12:55:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.058+0000 7f3766a77640 1 -- start start 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760162240 0x7f37601629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37600d3a10 con 0x7f376006d520 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37600d3890 con 0x7f3760162240 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3766a77640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f37600d3b90 con 0x7f376006ba20 2024-04-16T12:55:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59508/0 (socket says 172.21.15.18:59508) 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 -- 172.21.15.18:0/4080506717 learned_addr learned my addr 172.21.15.18:0/4080506717 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3764813640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 -- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 msgr2=0x7f376015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3765014640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760162240 0x7f37601629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 -- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760162240 msgr2=0x7f37601629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760162240 0x7f37601629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 -- 172.21.15.18:0/4080506717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37600c8ac0 con 0x7f376006d520 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3764813640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.059+0000 7f3757fff640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3750000c00 tx=0x7f37500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.060+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750032650 con 0x7f376006d520 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.060+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37500327f0 con 0x7f376006d520 2024-04-16T12:55:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.060+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37600c8da0 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.060+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750032be0 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.060+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37600c9360 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.061+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37600752b0 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.061+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f375004c060 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.061+0000 7f37557fa640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 0x7f374c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.062+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f37500ada60 con 0x7f376006d520 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.062+0000 7f3764813640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 0x7f374c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.062+0000 7f3764813640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 0x7f374c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37600ce980 tx=0x7f375c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.066+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3750040070 con 0x7f376006d520 2024-04-16T12:55:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.250+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f376006dd30 con 0x7f376006d520 2024-04-16T12:55:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.251+0000 7f37557fa640 1 -- 172.21.15.18:0/4080506717 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f375007ba90 con 0x7f376006d520 2024-04-16T12:55:54.254 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 msgr2=0x7f374c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 0x7f374c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37600ce980 tx=0x7f375c008040 comp rx=0 tx=0).stop 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 msgr2=0x7f37600c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3750000c00 tx=0x7f37500046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 shutdown_connections 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f374c06c8f0 0x7f374c06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760162240 0x7f37601629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f376006d520 0x7f37600c83e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 --2- 172.21.15.18:0/4080506717 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f376006ba20 0x7f376015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 >> 172.21.15.18:0/4080506717 conn(0x7f37600d48b0 msgr2=0x7f37600b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 shutdown_connections 2024-04-16T12:55:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.253+0000 7f3766a77640 1 -- 172.21.15.18:0/4080506717 wait complete. 2024-04-16T12:55:54.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.368+0000 7f839c84a640 1 Processor -- start 2024-04-16T12:55:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.368+0000 7f839c84a640 1 -- start start 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f839c84a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 0x7f83980cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f839c84a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f839806e2c0 0x7f83980b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f839c84a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83980b2640 con 0x7f839815bc20 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f839c84a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f83980b3da0 con 0x7f839806e2c0 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f839c84a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f83980b28c0 con 0x7f839815b840 2024-04-16T12:55:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f8396d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f839806e2c0 0x7f83980b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f8396d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f839806e2c0 0x7f83980b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59524/0 (socket says 172.21.15.18:59524) 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.369+0000 7f8396d9d640 1 -- 172.21.15.18:0/2317039094 learned_addr learned my addr 172.21.15.18:0/2317039094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f839659c640 1 --2- 172.21.15.18:0/2317039094 >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 0x7f83980cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f8396d9d640 1 -- 172.21.15.18:0/2317039094 >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 msgr2=0x7f83980cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f8396d9d640 1 --2- 172.21.15.18:0/2317039094 >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 0x7f83980cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f8396d9d640 1 -- 172.21.15.18:0/2317039094 >> v1:172.21.15.104:6789/0 conn(0x7f839815bc20 legacy=0x7f839806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f8396d9d640 1 -- 172.21.15.18:0/2317039094 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83980b2ba0 con 0x7f839806e2c0 2024-04-16T12:55:54.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f839659c640 1 --2- 172.21.15.18:0/2317039094 >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 0x7f83980cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.370+0000 7f8396d9d640 1 --2- 172.21.15.18:0/2317039094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839806e2c0 0x7f83980b6c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83980b30e0 tx=0x7f838802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b132f03849a91cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839559a640 1 -- 172.21.15.18:0/2317039094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838802c9f0 con 0x7f839806e2c0 2024-04-16T12:55:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839559a640 1 -- 172.21.15.18:0/2317039094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838802cb90 con 0x7f839806e2c0 2024-04-16T12:55:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839559a640 1 -- 172.21.15.18:0/2317039094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880343f0 con 0x7f839806e2c0 2024-04-16T12:55:54.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 -- 172.21.15.18:0/2317039094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839806e2c0 msgr2=0x7f83980b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 --2- 172.21.15.18:0/2317039094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839806e2c0 0x7f83980b6c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f83980b30e0 tx=0x7f838802be50 comp rx=0 tx=0).stop 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 -- 172.21.15.18:0/2317039094 shutdown_connections 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 --2- 172.21.15.18:0/2317039094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839806e2c0 0x7f83980b6c30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 --2- 172.21.15.18:0/2317039094 >> v2:172.21.15.104:3300/0 conn(0x7f839815b840 0x7f83980cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 -- 172.21.15.18:0/2317039094 >> 172.21.15.18:0/2317039094 conn(0x7f839809aa10 msgr2=0x7f83980b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 -- 172.21.15.18:0/2317039094 shutdown_connections 2024-04-16T12:55:54.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.371+0000 7f839c84a640 1 -- 172.21.15.18:0/2317039094 wait complete. 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 Processor -- start 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 -- start start 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839806e2c0 0x7f8398152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f839815b840 0x7f83980c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83980b39a0 con 0x7f839809ee60 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f83980b3820 con 0x7f839806e2c0 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f839c84a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f83980b3b20 con 0x7f839815b840 2024-04-16T12:55:54.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f8396d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f8396d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59540/0 (socket says 172.21.15.18:59540) 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.373+0000 7f8396d9d640 1 -- 172.21.15.18:0/4066350309 learned_addr learned my addr 172.21.15.18:0/4066350309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 -- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f839815b840 msgr2=0x7f83980c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f839815b840 0x7f83980c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f839659c640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839806e2c0 0x7f8398152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 -- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839806e2c0 msgr2=0x7f8398152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839806e2c0 0x7f8398152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 -- 172.21.15.18:0/4066350309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83980ca0f0 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f8396d9d640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8388009f40 tx=0x7f8388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388043020 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838803e450 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83980ca390 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838803e860 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.374+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83980ca950 con 0x7f839809ee60 2024-04-16T12:55:54.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.375+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8398068a70 con 0x7f839809ee60 2024-04-16T12:55:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.376+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8388046020 con 0x7f839809ee60 2024-04-16T12:55:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.376+0000 7f838effd640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 0x7f837806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.376+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f83880ae950 con 0x7f839809ee60 2024-04-16T12:55:54.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.376+0000 7f839659c640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 0x7f837806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.377+0000 7f839659c640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 0x7f837806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f839806dfe0 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.380+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f838804d030 con 0x7f839809ee60 2024-04-16T12:55:54.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.567+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83980d23b0 con 0x7f839809ee60 2024-04-16T12:55:54.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.568+0000 7f838effd640 1 -- 172.21.15.18:0/4066350309 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f83980b2640 con 0x7f839809ee60 2024-04-16T12:55:54.571 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:54.571 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:54.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 msgr2=0x7f837806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 0x7f837806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f839806dfe0 tx=0x7f8390008040 comp rx=0 tx=0).stop 2024-04-16T12:55:54.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 msgr2=0x7f839809b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8388009f40 tx=0x7f8388004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 shutdown_connections 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f837806c8f0 0x7f837806edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f839809ee60 0x7f839809b500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f839815b840 0x7f83980c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 --2- 172.21.15.18:0/4066350309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839806e2c0 0x7f8398152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 >> 172.21.15.18:0/4066350309 conn(0x7f839809aa10 msgr2=0x7f83980b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 shutdown_connections 2024-04-16T12:55:54.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.570+0000 7f839c84a640 1 -- 172.21.15.18:0/4066350309 wait complete. 2024-04-16T12:55:54.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:54.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:54.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.690+0000 7facbdb32640 1 Processor -- start 2024-04-16T12:55:54.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.690+0000 7facbdb32640 1 -- start start 2024-04-16T12:55:54.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facbdb32640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facb80d4460 0x7facb80d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facbdb32640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7facb80d17a0 0x7facb80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facbdb32640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb80d33c0 con 0x7facb815eb00 2024-04-16T12:55:54.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facbdb32640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7facb80d1c10 con 0x7facb80d4460 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facbdb32640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7facb80d36a0 con 0x7facb80d17a0 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facb80d4460 0x7facb80d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb77fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7facb815eb00 0x7facb80d2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43418/0 (socket says 172.21.15.18:43418) 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb77fe640 1 -- 172.21.15.18:0/665187760 learned_addr learned my addr 172.21.15.18:0/665187760 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb7fff640 1 --2- 172.21.15.18:0/665187760 >> v2:172.21.15.104:3300/0 conn(0x7facb80d17a0 0x7facb80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb6ffd640 1 -- 172.21.15.18:0/665187760 >> v2:172.21.15.104:3300/0 conn(0x7facb80d17a0 msgr2=0x7facb80b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb6ffd640 1 --2- 172.21.15.18:0/665187760 >> v2:172.21.15.104:3300/0 conn(0x7facb80d17a0 0x7facb80b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb6ffd640 1 -- 172.21.15.18:0/665187760 >> v1:172.21.15.18:6789/0 conn(0x7facb815eb00 legacy=0x7facb80d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.691+0000 7facb6ffd640 1 -- 172.21.15.18:0/665187760 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb80d3980 con 0x7facb80d4460 2024-04-16T12:55:54.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facb6ffd640 1 --2- 172.21.15.18:0/665187760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d4460 0x7facb80d1260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7facb80d06e0 tx=0x7facac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f1374455056e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facb67fc640 1 -- 172.21.15.18:0/665187760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0315a0 con 0x7facb80d4460 2024-04-16T12:55:54.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facb67fc640 1 -- 172.21.15.18:0/665187760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac037070 con 0x7facb80d4460 2024-04-16T12:55:54.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facb67fc640 1 -- 172.21.15.18:0/665187760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac031960 con 0x7facb80d4460 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facbdb32640 1 -- 172.21.15.18:0/665187760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d4460 msgr2=0x7facb80d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.692+0000 7facbdb32640 1 --2- 172.21.15.18:0/665187760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d4460 0x7facb80d1260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7facb80d06e0 tx=0x7facac02b840 comp rx=0 tx=0).stop 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 -- 172.21.15.18:0/665187760 shutdown_connections 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 --2- 172.21.15.18:0/665187760 >> v2:172.21.15.104:3300/0 conn(0x7facb80d17a0 0x7facb80b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 --2- 172.21.15.18:0/665187760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d4460 0x7facb80d1260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 -- 172.21.15.18:0/665187760 >> 172.21.15.18:0/665187760 conn(0x7facb806d490 msgr2=0x7facb80b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 -- 172.21.15.18:0/665187760 shutdown_connections 2024-04-16T12:55:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.693+0000 7facbdb32640 1 -- 172.21.15.18:0/665187760 wait complete. 2024-04-16T12:55:54.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.694+0000 7facbdb32640 1 Processor -- start 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.694+0000 7facbdb32640 1 -- start start 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb80d4460 0x7facb80cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7facb815eb00 0x7facb80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7facb815eee0 con 0x7facb80d17a0 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7facb80d3f40 con 0x7facb80d4460 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7facb80ba710 con 0x7facb815eb00 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59550/0 (socket says 172.21.15.18:59550) 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 -- 172.21.15.18:0/2012118800 learned_addr learned my addr 172.21.15.18:0/2012118800 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb6ffd640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb80d4460 0x7facb80cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb7fff640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7facb815eb00 0x7facb80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 -- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7facb815eb00 msgr2=0x7facb80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7facb815eb00 0x7facb80cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 -- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb80d4460 msgr2=0x7facb80cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb80d4460 0x7facb80cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 -- 172.21.15.18:0/2012118800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8158b90 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facb77fe640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faca800c3c0 tx=0x7faca800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8017070 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca8005ce0 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb8158e70 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca80072f0 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.695+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb8159430 con 0x7facb80d17a0 2024-04-16T12:55:54.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.696+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb80752b0 con 0x7facb80d17a0 2024-04-16T12:55:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.697+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faca801a070 con 0x7facb80d17a0 2024-04-16T12:55:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.697+0000 7fac9ffff640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 0x7faca406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.698+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faca808b2f0 con 0x7facb80d17a0 2024-04-16T12:55:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.698+0000 7facb6ffd640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 0x7faca406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:54.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.698+0000 7facb6ffd640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 0x7faca406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facac036000 tx=0x7facac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:54.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.702+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faca8059320 con 0x7facb80d17a0 2024-04-16T12:55:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.886+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facb80d4840 con 0x7facb80d17a0 2024-04-16T12:55:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.887+0000 7fac9ffff640 1 -- 172.21.15.18:0/2012118800 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7faca8058c20 con 0x7facb80d17a0 2024-04-16T12:55:54.889 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 msgr2=0x7faca406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 0x7faca406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facac036000 tx=0x7facac008030 comp rx=0 tx=0).stop 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 msgr2=0x7facb81f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faca800c3c0 tx=0x7faca800c880 comp rx=0 tx=0).stop 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 shutdown_connections 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faca406c8f0 0x7faca406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7facb815eb00 0x7facb80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb80d4460 0x7facb80cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 --2- 172.21.15.18:0/2012118800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facb80d17a0 0x7facb81f74f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 >> 172.21.15.18:0/2012118800 conn(0x7facb806d490 msgr2=0x7facb80b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 shutdown_connections 2024-04-16T12:55:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:54.889+0000 7facbdb32640 1 -- 172.21.15.18:0/2012118800 wait complete. 2024-04-16T12:55:54.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:55.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.009+0000 7f942aa14640 1 Processor -- start 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.009+0000 7f942aa14640 1 -- start start 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f942aa14640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 0x7f94240d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f942aa14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94240d4370 0x7f942406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f942aa14640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94240d2d90 con 0x7f942415eca0 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f942aa14640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f942415f080 con 0x7f94240d4370 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f942aa14640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f94240d3070 con 0x7f94240b37e0 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9428fb1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94240d4370 0x7f942406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9423fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f942415eca0 0x7f942406c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43430/0 (socket says 172.21.15.18:43430) 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9423fff640 1 -- 172.21.15.18:0/863655727 learned_addr learned my addr 172.21.15.18:0/863655727 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f94237fe640 1 --2- 172.21.15.18:0/863655727 >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 0x7f94240d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9428fb1640 1 -- 172.21.15.18:0/863655727 >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 msgr2=0x7f94240d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9428fb1640 1 --2- 172.21.15.18:0/863655727 >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 0x7f94240d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9428fb1640 1 -- 172.21.15.18:0/863655727 >> v1:172.21.15.18:6789/0 conn(0x7f942415eca0 legacy=0x7f942406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f9428fb1640 1 -- 172.21.15.18:0/863655727 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94240d3350 con 0x7f94240d4370 2024-04-16T12:55:55.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.010+0000 7f94237fe640 1 --2- 172.21.15.18:0/863655727 >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 0x7f94240d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.011+0000 7f9428fb1640 1 --2- 172.21.15.18:0/863655727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f942406ce10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9424069180 tx=0x7f941c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90f559f5742299f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.011+0000 7f9422ffd640 1 -- 172.21.15.18:0/863655727 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c039070 con 0x7f94240d4370 2024-04-16T12:55:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.011+0000 7f9422ffd640 1 -- 172.21.15.18:0/863655727 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c02cd00 con 0x7f94240d4370 2024-04-16T12:55:55.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.011+0000 7f9422ffd640 1 -- 172.21.15.18:0/863655727 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c034660 con 0x7f94240d4370 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 -- 172.21.15.18:0/863655727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 msgr2=0x7f942406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 --2- 172.21.15.18:0/863655727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f942406ce10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9424069180 tx=0x7f941c02bf50 comp rx=0 tx=0).stop 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 -- 172.21.15.18:0/863655727 shutdown_connections 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 --2- 172.21.15.18:0/863655727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f942406ce10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 --2- 172.21.15.18:0/863655727 >> v2:172.21.15.104:3300/0 conn(0x7f94240b37e0 0x7f94240d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 -- 172.21.15.18:0/863655727 >> 172.21.15.18:0/863655727 conn(0x7f94240d48b0 msgr2=0x7f94240d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 -- 172.21.15.18:0/863655727 shutdown_connections 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.012+0000 7f942aa14640 1 -- 172.21.15.18:0/863655727 wait complete. 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.013+0000 7f942aa14640 1 Processor -- start 2024-04-16T12:55:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.013+0000 7f942aa14640 1 -- start start 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 0x7f94240cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942415eca0 0x7f94240ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f942406d350 con 0x7f94240d4370 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f94240d3910 con 0x7f94240b37e0 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f942406d4d0 con 0x7f942415eca0 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59566/0 (socket says 172.21.15.18:59566) 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 -- 172.21.15.18:0/664361519 learned_addr learned my addr 172.21.15.18:0/664361519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9423fff640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 0x7f94240cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9428fb1640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942415eca0 0x7f94240ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 -- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942415eca0 msgr2=0x7f94240ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942415eca0 0x7f94240ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 -- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 msgr2=0x7f94240cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 0x7f94240cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 -- 172.21.15.18:0/664361519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94241f54e0 con 0x7f94240d4370 2024-04-16T12:55:55.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9423fff640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 0x7f94240cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:55.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f94237fe640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f941800e7e0 tx=0x7f941800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800f040 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418004030 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94241f57c0 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.014+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418004400 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.015+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94241f5d80 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.015+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94240752b0 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.016+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f941800c6d0 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.016+0000 7f9420ff9640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 0x7f941006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.016+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f941808bdf0 con 0x7f94240d4370 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.017+0000 7f9423fff640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 0x7f941006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.017+0000 7f9423fff640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 0x7f941006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94240b3280 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.021+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9418017020 con 0x7f94240d4370 2024-04-16T12:55:55.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.203+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f94240b7700 con 0x7f94240d4370 2024-04-16T12:55:55.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.204+0000 7f9420ff9640 1 -- 172.21.15.18:0/664361519 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f9418059d80 con 0x7f94240d4370 2024-04-16T12:55:55.206 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 msgr2=0x7f941006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 0x7f941006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94240b3280 tx=0x7f9414009040 comp rx=0 tx=0).stop 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 msgr2=0x7f94241f4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f941800e7e0 tx=0x7f941800eca0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 shutdown_connections 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f941006c8f0 0x7f941006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942415eca0 0x7f94240ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94240d4370 0x7f94241f4d40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 --2- 172.21.15.18:0/664361519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94240b37e0 0x7f94240cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 >> 172.21.15.18:0/664361519 conn(0x7f94240d48b0 msgr2=0x7f94240b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 shutdown_connections 2024-04-16T12:55:55.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.206+0000 7f942aa14640 1 -- 172.21.15.18:0/664361519 wait complete. 2024-04-16T12:55:55.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.325+0000 7ffaa1732640 1 Processor -- start 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.325+0000 7ffaa1732640 1 -- start start 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffaa1732640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa9c162630 0x7ffa9c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffaa1732640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffa9c0cfad0 0x7ffa9c0d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffaa1732640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa9c0b7a60 con 0x7ffa9c15eb60 2024-04-16T12:55:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffaa1732640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9c0d2f30 con 0x7ffa9c162630 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffaa1732640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9c15ef40 con 0x7ffa9c0cfad0 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa9c162630 0x7ffa9c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa9c162630 0x7ffa9c0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59576/0 (socket says 172.21.15.18:59576) 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 -- 172.21.15.18:0/153441344 learned_addr learned my addr 172.21.15.18:0/153441344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9b7fe640 1 --2- 172.21.15.18:0/153441344 >> v2:172.21.15.104:3300/0 conn(0x7ffa9c0cfad0 0x7ffa9c0d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 -- 172.21.15.18:0/153441344 >> v2:172.21.15.104:3300/0 conn(0x7ffa9c0cfad0 msgr2=0x7ffa9c0d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 --2- 172.21.15.18:0/153441344 >> v2:172.21.15.104:3300/0 conn(0x7ffa9c0cfad0 0x7ffa9c0d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.326+0000 7ffa9a7fc640 1 -- 172.21.15.18:0/153441344 >> v1:172.21.15.104:6789/0 conn(0x7ffa9c15eb60 legacy=0x7ffa9c0ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.327+0000 7ffa9a7fc640 1 -- 172.21.15.18:0/153441344 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c162a90 con 0x7ffa9c162630 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.327+0000 7ffa9a7fc640 1 --2- 172.21.15.18:0/153441344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cf590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0d2060 tx=0x7ffa8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40cc4df34725f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.327+0000 7ffa99ffb640 1 -- 172.21.15.18:0/153441344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84034070 con 0x7ffa9c162630 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.327+0000 7ffa99ffb640 1 -- 172.21.15.18:0/153441344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa84030860 con 0x7ffa9c162630 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.327+0000 7ffa99ffb640 1 -- 172.21.15.18:0/153441344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84030c30 con 0x7ffa9c162630 2024-04-16T12:55:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 -- 172.21.15.18:0/153441344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 msgr2=0x7ffa9c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 --2- 172.21.15.18:0/153441344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cf590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0d2060 tx=0x7ffa8402b9a0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 -- 172.21.15.18:0/153441344 shutdown_connections 2024-04-16T12:55:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 --2- 172.21.15.18:0/153441344 >> v2:172.21.15.104:3300/0 conn(0x7ffa9c0cfad0 0x7ffa9c0d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 --2- 172.21.15.18:0/153441344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cf590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 -- 172.21.15.18:0/153441344 >> 172.21.15.18:0/153441344 conn(0x7ffa9c0b65b0 msgr2=0x7ffa9c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 -- 172.21.15.18:0/153441344 shutdown_connections 2024-04-16T12:55:55.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.328+0000 7ffaa1732640 1 -- 172.21.15.18:0/153441344 wait complete. 2024-04-16T12:55:55.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.329+0000 7ffaa1732640 1 Processor -- start 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.329+0000 7ffaa1732640 1 -- start start 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffa9c0cfad0 0x7ffa9c0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 0x7ffa9c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c1632f0 con 0x7ffa9c162630 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c163010 con 0x7ffa9c15eb60 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffaa1732640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9c0d3900 con 0x7ffa9c0cfad0 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59586/0 (socket says 172.21.15.18:59586) 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffa9b7fe640 1 -- 172.21.15.18:0/892394584 learned_addr learned my addr 172.21.15.18:0/892394584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffa9a7fc640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 0x7ffa9c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.330+0000 7ffa9affd640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffa9c0cfad0 0x7ffa9c0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 -- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffa9c0cfad0 msgr2=0x7ffa9c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffa9c0cfad0 0x7ffa9c0b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 -- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 msgr2=0x7ffa9c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 0x7ffa9c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 -- 172.21.15.18:0/892394584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c0b3f90 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9a7fc640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 0x7ffa9c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa9b7fe640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d800 tx=0x7ffa9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400b6c0 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa94019070 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c0ce890 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400bac0 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.331+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c0c93c0 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.332+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c0752b0 con 0x7ffa9c162630 2024-04-16T12:55:55.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.332+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa9400bc60 con 0x7ffa9c162630 2024-04-16T12:55:55.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.333+0000 7ffa937fe640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 0x7ffa7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.333+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffa9408c330 con 0x7ffa9c162630 2024-04-16T12:55:55.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.333+0000 7ffa9affd640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 0x7ffa7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.333+0000 7ffa9affd640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 0x7ffa7c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001d40 tx=0x7ffa8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.337+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa9405a3f0 con 0x7ffa9c162630 2024-04-16T12:55:55.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.520+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa9c0d25d0 con 0x7ffa9c162630 2024-04-16T12:55:55.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.520+0000 7ffa937fe640 1 -- 172.21.15.18:0/892394584 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ffa94059cf0 con 0x7ffa9c162630 2024-04-16T12:55:55.524 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:55.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 msgr2=0x7ffa7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 0x7ffa7c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001d40 tx=0x7ffa8c009040 comp rx=0 tx=0).stop 2024-04-16T12:55:55.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 msgr2=0x7ffa9c0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400d800 tx=0x7ffa9400dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 shutdown_connections 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ffa7c06c8f0 0x7ffa7c06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9c162630 0x7ffa9c0cc150 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa9c15eb60 0x7ffa9c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 --2- 172.21.15.18:0/892394584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ffa9c0cfad0 0x7ffa9c0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 >> 172.21.15.18:0/892394584 conn(0x7ffa9c0b65b0 msgr2=0x7ffa9c0b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 shutdown_connections 2024-04-16T12:55:55.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.522+0000 7ffaa1732640 1 -- 172.21.15.18:0/892394584 wait complete. 2024-04-16T12:55:55.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:55.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.641+0000 7f878a4b2640 1 Processor -- start 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.641+0000 7f878a4b2640 1 -- start start 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f878a4b2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87840b3a00 0x7f87840d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f878a4b2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8784163480 con 0x7f878415ef70 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f878a4b2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8784163760 con 0x7f878406c130 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f878a4b2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f878415f350 con 0x7f87840b3a00 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f8783fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f878415ef70 0x7f878406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43436/0 (socket says 172.21.15.18:43436) 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f8783fff640 1 -- 172.21.15.18:0/3555896809 learned_addr learned my addr 172.21.15.18:0/3555896809 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.642+0000 7f8788a4f640 1 --2- 172.21.15.18:0/3555896809 >> v2:172.21.15.104:3300/0 conn(0x7f87840b3a00 0x7f87840d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434293180 0 0) 0x7f8784163480 con 0x7f878415ef70 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f876c003520 con 0x7f878415ef70 2024-04-16T12:55:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1353526986 0 0) 0x7f876c003520 con 0x7f878415ef70 2024-04-16T12:55:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 >> v2:172.21.15.104:3300/0 conn(0x7f87840b3a00 msgr2=0x7f87840d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 --2- 172.21.15.18:0/3555896809 >> v2:172.21.15.104:3300/0 conn(0x7f87840b3a00 0x7f87840d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 >> v1:172.21.15.104:6789/0 conn(0x7f878406c130 legacy=0x7f87840d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87840d26c0 con 0x7f878415ef70 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f8774001670 con 0x7f878415ef70 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 >> v1:172.21.15.18:6789/0 conn(0x7f878415ef70 legacy=0x7f878406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0039b0 0x7f876c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f876c004800 0x7f876c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 0x7f876c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f878415f350 con 0x7f876c0051c0 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f876c00c060 con 0x7f876c0039b0 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f876c00c260 con 0x7f876c004800 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 0x7f876c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8783fff640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0039b0 0x7f876c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f87837fe640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f876c004800 0x7f876c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 -- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f876c004800 msgr2=0x7f876c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f876c004800 0x7f876c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 -- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0039b0 msgr2=0x7f876c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0039b0 0x7f876c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.643+0000 7f8788a4f640 1 -- 172.21.15.18:0/3555896809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c003520 con 0x7f876c0051c0 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.644+0000 7f8788a4f640 1 -- 172.21.15.18:0/3555896809 reap_dead start 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.644+0000 7f8788a4f640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 0x7f876c00b9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f877c009fc0 tx=0x7f876c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137f6c26572d4c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.644+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c009c10 con 0x7f876c0051c0 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.644+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c02cca0 con 0x7f876c0051c0 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.644+0000 7f8782ffd640 1 -- 172.21.15.18:0/3555896809 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c003bd0 con 0x7f876c0051c0 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 -- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 msgr2=0x7f876c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 0x7f876c00b9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f877c009fc0 tx=0x7f876c005830 comp rx=0 tx=0).stop 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 -- 172.21.15.18:0/3555896809 shutdown_connections 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 --2- 172.21.15.18:0/3555896809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f876c0051c0 0x7f876c00b9c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 -- 172.21.15.18:0/3555896809 >> 172.21.15.18:0/3555896809 conn(0x7f87840b69e0 msgr2=0x7f87840d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 -- 172.21.15.18:0/3555896809 shutdown_connections 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.645+0000 7f878a4b2640 1 -- 172.21.15.18:0/3555896809 wait complete. 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.646+0000 7f878a4b2640 1 Processor -- start 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.646+0000 7f878a4b2640 1 -- start start 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 0x7f87841ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8784159ec0 0x7f878414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87840d2a30 con 0x7f87840c83b0 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f87840d2470 con 0x7f876c0051c0 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f878a4b2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f87840b34b0 con 0x7f8784159ec0 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59612/0 (socket says 172.21.15.18:59612) 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 -- 172.21.15.18:0/2173023575 learned_addr learned my addr 172.21.15.18:0/2173023575 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f87837fe640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8784159ec0 0x7f878414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8783fff640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 0x7f87841ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 -- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8784159ec0 msgr2=0x7f878414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8784159ec0 0x7f878414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 -- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 msgr2=0x7f87841ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 0x7f87841ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 -- 172.21.15.18:0/2173023575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878415fd00 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8783fff640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 0x7f87841ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.647+0000 7f8788a4f640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f877c035d50 tx=0x7f877c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.648+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c042020 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.648+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c02ce50 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.648+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87841ea980 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.648+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c003bf0 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.648+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87841eaf40 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.649+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878406ba20 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.649+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f877c045020 con 0x7f87840c83b0 2024-04-16T12:55:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.650+0000 7f8780ff9640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.650+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f877c0ae800 con 0x7f87840c83b0 2024-04-16T12:55:55.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.650+0000 7f8783fff640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.651+0000 7f8783fff640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 0x7f877006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8774007c70 tx=0x7f8774009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.654+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f878406ba20 con 0x7f87840c83b0 2024-04-16T12:55:55.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.840+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f87840752b0 con 0x7f87840c83b0 2024-04-16T12:55:55.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.840+0000 7f8780ff9640 1 -- 172.21.15.18:0/2173023575 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f877c04c020 con 0x7f87840c83b0 2024-04-16T12:55:55.843 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 msgr2=0x7f877006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 0x7f877006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8774007c70 tx=0x7f8774009040 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 msgr2=0x7f87840c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f877c035d50 tx=0x7f877c009750 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 shutdown_connections 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f877006c8f0 0x7f877006edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87840c83b0 0x7f87840c8830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8784159ec0 0x7f878414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 --2- 172.21.15.18:0/2173023575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f876c0051c0 0x7f87841ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 >> 172.21.15.18:0/2173023575 conn(0x7f87840b69e0 msgr2=0x7f87840b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.842+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 shutdown_connections 2024-04-16T12:55:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.843+0000 7f878a4b2640 1 -- 172.21.15.18:0/2173023575 wait complete. 2024-04-16T12:55:55.862 INFO:tasks.cephfs_test_runner:Starting test: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-04-16T12:55:55.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:55.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.966+0000 7fec38150640 1 Processor -- start 2024-04-16T12:55:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.966+0000 7fec38150640 1 -- start start 2024-04-16T12:55:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec38150640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec30070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec38150640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fec3009b120 0x7fec300ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec38150640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec30070840 con 0x7fec300d0ef0 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec38150640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fec30070b20 con 0x7fec3009b120 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec38150640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fec30070e00 con 0x7fec300cea50 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fec3009b120 0x7fec300ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fec3009b120 0x7fec300ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59622/0 (socket says 172.21.15.18:59622) 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 -- 172.21.15.18:0/3785450720 learned_addr learned my addr 172.21.15.18:0/3785450720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec35eec640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec30070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 -- 172.21.15.18:0/3785450720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 msgr2=0x7fec30070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec30070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 -- 172.21.15.18:0/3785450720 >> v1:172.21.15.104:6789/0 conn(0x7fec300d0ef0 legacy=0x7fec3009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.967+0000 7fec366ed640 1 -- 172.21.15.18:0/3785450720 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec300710e0 con 0x7fec3009b120 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.968+0000 7fec366ed640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300ccf70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec28009e50 tx=0x7fec2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b949ea0062da26 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.968+0000 7fec34eea640 1 -- 172.21.15.18:0/3785450720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2802cb00 con 0x7fec3009b120 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.968+0000 7fec34eea640 1 -- 172.21.15.18:0/3785450720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2802cca0 con 0x7fec3009b120 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.968+0000 7fec34eea640 1 -- 172.21.15.18:0/3785450720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28034610 con 0x7fec3009b120 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 -- 172.21.15.18:0/3785450720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 msgr2=0x7fec300ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300ccf70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec28009e50 tx=0x7fec2802bf60 comp rx=0 tx=0).stop 2024-04-16T12:55:55.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 -- 172.21.15.18:0/3785450720 shutdown_connections 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300ccf70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 --2- 172.21.15.18:0/3785450720 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec30070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 -- 172.21.15.18:0/3785450720 >> 172.21.15.18:0/3785450720 conn(0x7fec300d2600 msgr2=0x7fec300d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 -- 172.21.15.18:0/3785450720 shutdown_connections 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.969+0000 7fec38150640 1 -- 172.21.15.18:0/3785450720 wait complete. 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.970+0000 7fec38150640 1 Processor -- start 2024-04-16T12:55:55.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.970+0000 7fec38150640 1 -- start start 2024-04-16T12:55:55.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec301f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec300d0ef0 0x7fec3014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec300718e0 con 0x7fec3009b120 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fec300cee30 con 0x7fec300d0ef0 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fec300d1330 con 0x7fec300cea50 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59636/0 (socket says 172.21.15.18:59636) 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 -- 172.21.15.18:0/1556788745 learned_addr learned my addr 172.21.15.18:0/1556788745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 -- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 msgr2=0x7fec301f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec301f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 -- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec300d0ef0 msgr2=0x7fec3014e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec300d0ef0 0x7fec3014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 -- 172.21.15.18:0/1556788745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3014d930 con 0x7fec3009b120 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec35eec640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00d800 tx=0x7fec2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00b6c0 con 0x7fec3009b120 2024-04-16T12:55:55.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2c019070 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3014dc10 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.971+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00ba80 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.972+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3014e1d0 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.972+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec300752b0 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.973+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec2c00bc20 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.973+0000 7fec267fc640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 0x7fec1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.973+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fec2c08c3b0 con 0x7fec3009b120 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.974+0000 7fec356eb640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 0x7fec1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.974+0000 7fec356eb640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 0x7fec1406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec20006fd0 tx=0x7fec20006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:55.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:55.977+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec2c01c360 con 0x7fec3009b120 2024-04-16T12:55:56.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.164+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec300d3340 con 0x7fec3009b120 2024-04-16T12:55:56.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.165+0000 7fec267fc640 1 -- 172.21.15.18:0/1556788745 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7fec2c05a470 con 0x7fec3009b120 2024-04-16T12:55:56.168 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:56.168 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 msgr2=0x7fec1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 0x7fec1406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec20006fd0 tx=0x7fec20006bc0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 msgr2=0x7fec300cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00d800 tx=0x7fec2c00dcc0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 shutdown_connections 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fec1406c8f0 0x7fec1406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec300d0ef0 0x7fec3014e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fec300cea50 0x7fec301f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 --2- 172.21.15.18:0/1556788745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3009b120 0x7fec300cc5a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 >> 172.21.15.18:0/1556788745 conn(0x7fec300d2600 msgr2=0x7fec300b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 shutdown_connections 2024-04-16T12:55:56.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.167+0000 7fec38150640 1 -- 172.21.15.18:0/1556788745 wait complete. 2024-04-16T12:55:56.181 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:56.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.287+0000 7fe6ecb15640 1 Processor -- start 2024-04-16T12:55:56.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.287+0000 7fe6ecb15640 1 -- start start 2024-04-16T12:55:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6ecb15640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6e815eb60 0x7fe6e8162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6ecb15640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e80cfca0 0x7fe6e80d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6ecb15640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e80b7a60 con 0x7fe6e80ba350 2024-04-16T12:55:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6ecb15640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e80d2f30 con 0x7fe6e815eb60 2024-04-16T12:55:56.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6ecb15640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e815ef40 con 0x7fe6e80cfca0 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6e815eb60 0x7fe6e8162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe6e80ba350 0x7fe6e80cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43444/0 (socket says 172.21.15.18:43444) 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6dffff640 1 -- 172.21.15.18:0/940997723 learned_addr learned my addr 172.21.15.18:0/940997723 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6e815eb60 0x7fe6e8162630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59646/0 (socket says 172.21.15.18:59646) 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e6d9d640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e80cfca0 0x7fe6e80d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 -- 172.21.15.18:0/940997723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e80cfca0 msgr2=0x7fe6e80d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e80cfca0 0x7fe6e80d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 -- 172.21.15.18:0/940997723 >> v1:172.21.15.18:6789/0 conn(0x7fe6e80ba350 legacy=0x7fe6e80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e659c640 1 -- 172.21.15.18:0/940997723 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e8162d30 con 0x7fe6e815eb60 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.288+0000 7fe6e5d9b640 1 -- 172.21.15.18:0/940997723 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619225337 0 0) 0x7fe6d0001110 con 0x7fe6e80ba350 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.289+0000 7fe6e659c640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e815eb60 0x7fe6e8162630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e8e2f86d782200 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.289+0000 7fe6e5d9b640 1 -- 172.21.15.18:0/940997723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8035020 con 0x7fe6e815eb60 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.289+0000 7fe6e5d9b640 1 -- 172.21.15.18:0/940997723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8031830 con 0x7fe6e815eb60 2024-04-16T12:55:56.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.289+0000 7fe6e5d9b640 1 -- 172.21.15.18:0/940997723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8031c00 con 0x7fe6e815eb60 2024-04-16T12:55:56.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 -- 172.21.15.18:0/940997723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e815eb60 msgr2=0x7fe6e8162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e815eb60 0x7fe6e8162630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 -- 172.21.15.18:0/940997723 shutdown_connections 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e80cfca0 0x7fe6e80d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/940997723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e815eb60 0x7fe6e8162630 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 -- 172.21.15.18:0/940997723 >> 172.21.15.18:0/940997723 conn(0x7fe6e80b65b0 msgr2=0x7fe6e80b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 -- 172.21.15.18:0/940997723 shutdown_connections 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.290+0000 7fe6ecb15640 1 -- 172.21.15.18:0/940997723 wait complete. 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.291+0000 7fe6ecb15640 1 Processor -- start 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.291+0000 7fe6ecb15640 1 -- start start 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e80cfca0 0x7fe6e8160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 0x7fe6e81f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e80ba7b0 con 0x7fe6e80ba350 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e81632f0 con 0x7fe6e80cfca0 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6ecb15640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e80d3900 con 0x7fe6e815eb60 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59656/0 (socket says 172.21.15.18:59656) 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 -- 172.21.15.18:0/1968388475 learned_addr learned my addr 172.21.15.18:0/1968388475 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e6d9d640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 0x7fe6e81f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6dffff640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e80cfca0 0x7fe6e8160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 -- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 msgr2=0x7fe6e81f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 0x7fe6e81f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 -- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e80cfca0 msgr2=0x7fe6e8160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e80cfca0 0x7fe6e8160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 -- 172.21.15.18:0/1968388475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e80ccb10 con 0x7fe6e80ba350 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e6d9d640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 0x7fe6e81f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6e659c640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.292+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8035040 con 0x7fe6e80ba350 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.293+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8004230 con 0x7fe6e80ba350 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.293+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e8161930 con 0x7fe6e80ba350 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.293+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d803a700 con 0x7fe6e80ba350 2024-04-16T12:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.293+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e80ccdd0 con 0x7fe6e80ba350 2024-04-16T12:55:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.294+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e80752b0 con 0x7fe6e80ba350 2024-04-16T12:55:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.294+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6d8038020 con 0x7fe6e80ba350 2024-04-16T12:55:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.295+0000 7fe6deffd640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.295+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe6d80add10 con 0x7fe6e80ba350 2024-04-16T12:55:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.295+0000 7fe6dffff640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.295+0000 7fe6dffff640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 0x7fe6c806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80cb2b0 tx=0x7fe6d0007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.299+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6d807bd40 con 0x7fe6e80ba350 2024-04-16T12:55:56.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.483+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe6e80c8c20 con 0x7fe6e80ba350 2024-04-16T12:55:56.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.484+0000 7fe6deffd640 1 -- 172.21.15.18:0/1968388475 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fe6d807b640 con 0x7fe6e80ba350 2024-04-16T12:55:56.486 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.485+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 msgr2=0x7fe6c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.485+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 0x7fe6c806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80cb2b0 tx=0x7fe6d0007970 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.485+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 msgr2=0x7fe6e80b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d80046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 shutdown_connections 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe6e815eb60 0x7fe6e81f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e80cfca0 0x7fe6e8160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 --2- 172.21.15.18:0/1968388475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6e80ba350 0x7fe6e80b3800 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 >> 172.21.15.18:0/1968388475 conn(0x7fe6e80b65b0 msgr2=0x7fe6e80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 shutdown_connections 2024-04-16T12:55:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.486+0000 7fe6ecb15640 1 -- 172.21.15.18:0/1968388475 wait complete. 2024-04-16T12:55:56.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.608+0000 7f99e1f32640 1 Processor -- start 2024-04-16T12:55:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.608+0000 7f99e1f32640 1 -- start start 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99e1f32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 0x7f99dc0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99e1f32640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc163480 con 0x7f99dc15ef70 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99e1f32640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc163760 con 0x7f99dc0b3a00 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99e1f32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc15f350 con 0x7f99dc06c130 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99db7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f99dc15ef70 0x7f99dc06ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43446/0 (socket says 172.21.15.18:43446) 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99db7fe640 1 -- 172.21.15.18:0/3539338792 learned_addr learned my addr 172.21.15.18:0/3539338792 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99daffd640 1 --2- 172.21.15.18:0/3539338792 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 0x7f99dc0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872401393 0 0) 0x7f99dc163480 con 0x7f99dc15ef70 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99c4003520 con 0x7f99dc15ef70 2024-04-16T12:55:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751671867 0 0) 0x7f99dc163760 con 0x7f99dc0b3a00 2024-04-16T12:55:56.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99dc163480 con 0x7f99dc0b3a00 2024-04-16T12:55:56.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99daffd640 1 -- 172.21.15.18:0/3539338792 >> v1:172.21.15.104:6789/0 conn(0x7f99dc0b3a00 legacy=0x7f99dc0d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99daffd640 1 -- 172.21.15.18:0/3539338792 >> v1:172.21.15.18:6789/0 conn(0x7f99dc15ef70 legacy=0x7f99dc06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.609+0000 7f99daffd640 1 -- 172.21.15.18:0/3539338792 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc0d26c0 con 0x7f99dc06c130 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.610+0000 7f99daffd640 1 --2- 172.21.15.18:0/3539338792 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 0x7f99dc0d2ec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99d00097d0 tx=0x7f99d002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04ea3e7d49e2d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.610+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0035020 con 0x7f99dc06c130 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.610+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0031890 con 0x7f99dc06c130 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.610+0000 7f99da7fc640 1 -- 172.21.15.18:0/3539338792 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0031c40 con 0x7f99dc06c130 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 -- 172.21.15.18:0/3539338792 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 msgr2=0x7f99dc0d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 --2- 172.21.15.18:0/3539338792 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 0x7f99dc0d2ec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99d00097d0 tx=0x7f99d002b930 comp rx=0 tx=0).stop 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 -- 172.21.15.18:0/3539338792 shutdown_connections 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 --2- 172.21.15.18:0/3539338792 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc06c130 0x7f99dc0d2ec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 -- 172.21.15.18:0/3539338792 >> 172.21.15.18:0/3539338792 conn(0x7f99dc0b69e0 msgr2=0x7f99dc0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 -- 172.21.15.18:0/3539338792 shutdown_connections 2024-04-16T12:55:56.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.611+0000 7f99e1f32640 1 -- 172.21.15.18:0/3539338792 wait complete. 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.612+0000 7f99e1f32640 1 Processor -- start 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.612+0000 7f99e1f32640 1 -- start start 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc0b3a00 0x7f99dc1618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 0x7f99dc0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0d2a30 con 0x7f99dc06c130 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0d2470 con 0x7f99dc15ef70 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99e1f32640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc0b34b0 con 0x7f99dc0b3a00 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59660/0 (socket says 172.21.15.18:59660) 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 -- 172.21.15.18:0/422741898 learned_addr learned my addr 172.21.15.18:0/422741898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:56.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99daffd640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc0b3a00 0x7f99dc1618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99dbfff640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 0x7f99dc0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 -- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc0b3a00 msgr2=0x7f99dc1618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc0b3a00 0x7f99dc1618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 -- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 msgr2=0x7f99dc0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 0x7f99dc0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99db7fe640 1 -- 172.21.15.18:0/422741898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc154c00 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.613+0000 7f99dbfff640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 0x7f99dc0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99db7fe640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00c410 tx=0x7f99cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc017070 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc005ce0 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc0cb970 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0072d0 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.614+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc0cbf30 con 0x7f99dc06c130 2024-04-16T12:55:56.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.615+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc0752b0 con 0x7f99dc06c130 2024-04-16T12:55:56.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.615+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99cc01a070 con 0x7f99dc06c130 2024-04-16T12:55:56.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.616+0000 7f99c3fff640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.616+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f99cc08b1e0 con 0x7f99dc06c130 2024-04-16T12:55:56.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.616+0000 7f99daffd640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.617+0000 7f99daffd640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 0x7f99c806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99d0036000 tx=0x7f99d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.620+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99cc058c50 con 0x7f99dc06c130 2024-04-16T12:55:56.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.804+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f99dc0d1100 con 0x7f99dc06c130 2024-04-16T12:55:56.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.805+0000 7f99c3fff640 1 -- 172.21.15.18:0/422741898 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f99cc05cf50 con 0x7f99dc06c130 2024-04-16T12:55:56.807 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 msgr2=0x7f99c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 0x7f99c806edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99d0036000 tx=0x7f99d0008030 comp rx=0 tx=0).stop 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 msgr2=0x7f99dc1546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00c410 tx=0x7f99cc00c8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 shutdown_connections 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99dc15ef70 0x7f99dc0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f99dc0b3a00 0x7f99dc1618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 --2- 172.21.15.18:0/422741898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99dc06c130 0x7f99dc1546c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.806+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 >> 172.21.15.18:0/422741898 conn(0x7f99dc0b69e0 msgr2=0x7f99dc0b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.807+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 shutdown_connections 2024-04-16T12:55:56.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.807+0000 7f99e1f32640 1 -- 172.21.15.18:0/422741898 wait complete. 2024-04-16T12:55:56.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.924+0000 7feb38214640 1 Processor -- start 2024-04-16T12:55:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 -- start start 2024-04-16T12:55:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3015c640 0x7feb3006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 0x7feb300b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 0x7feb3006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7feb300b0e80 con 0x7feb3015c640 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7feb3006e450 con 0x7feb3015ef80 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.925+0000 7feb38214640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7feb3015f420 con 0x7feb3006db00 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3015c640 0x7feb3006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3015c640 0x7feb3006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59676/0 (socket says 172.21.15.18:59676) 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 -- 172.21.15.18:0/1267848363 learned_addr learned my addr 172.21.15.18:0/1267848363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb367b1640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 0x7feb3006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb357af640 1 --2- 172.21.15.18:0/1267848363 >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 0x7feb300b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 -- 172.21.15.18:0/1267848363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 msgr2=0x7feb3006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 0x7feb3006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 -- 172.21.15.18:0/1267848363 >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 msgr2=0x7feb300b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:56.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 --2- 172.21.15.18:0/1267848363 >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 0x7feb300b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb35fb0640 1 -- 172.21.15.18:0/1267848363 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3015f700 con 0x7feb3015c640 2024-04-16T12:55:56.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb367b1640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 0x7feb3006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:56.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.926+0000 7feb357af640 1 --2- 172.21.15.18:0/1267848363 >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 0x7feb300b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:56.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb35fb0640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb3006ba20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feb30074030 tx=0x7feb2802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402c7fd6d248ffed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb34fae640 1 -- 172.21.15.18:0/1267848363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28038070 con 0x7feb3015c640 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb34fae640 1 -- 172.21.15.18:0/1267848363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2802f050 con 0x7feb3015c640 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb34fae640 1 -- 172.21.15.18:0/1267848363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28031970 con 0x7feb3015c640 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 -- 172.21.15.18:0/1267848363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 msgr2=0x7feb3006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb3006ba20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feb30074030 tx=0x7feb2802b7f0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 -- 172.21.15.18:0/1267848363 shutdown_connections 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 --2- 172.21.15.18:0/1267848363 >> v2:172.21.15.104:3300/0 conn(0x7feb3015ef80 0x7feb300b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3006db00 0x7feb3006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 --2- 172.21.15.18:0/1267848363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb3006ba20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.927+0000 7feb38214640 1 -- 172.21.15.18:0/1267848363 >> 172.21.15.18:0/1267848363 conn(0x7feb30073550 msgr2=0x7feb3009aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.928+0000 7feb38214640 1 -- 172.21.15.18:0/1267848363 shutdown_connections 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.928+0000 7feb38214640 1 -- 172.21.15.18:0/1267848363 wait complete. 2024-04-16T12:55:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 Processor -- start 2024-04-16T12:55:56.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 -- start start 2024-04-16T12:55:56.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb3006db00 0x7feb3015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3015ef80 0x7feb301f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb300b52b0 con 0x7feb3015c640 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015fcc0 con 0x7feb3006db00 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.929+0000 7feb38214640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7feb300d1780 con 0x7feb3015ef80 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59680/0 (socket says 172.21.15.18:59680) 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 -- 172.21.15.18:0/2808586072 learned_addr learned my addr 172.21.15.18:0/2808586072 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb35fb0640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb3006db00 0x7feb3015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb367b1640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3015ef80 0x7feb301f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 -- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3015ef80 msgr2=0x7feb301f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3015ef80 0x7feb301f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 -- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb3006db00 msgr2=0x7feb3015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb3006db00 0x7feb3015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 -- 172.21.15.18:0/2808586072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300d0fc0 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb357af640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c7f0 tx=0x7feb2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24015070 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb24007820 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb300d03b0 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24007bd0 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.930+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb300d0970 con 0x7feb3015c640 2024-04-16T12:55:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.931+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb300af880 con 0x7feb3015c640 2024-04-16T12:55:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.932+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb24018070 con 0x7feb3015c640 2024-04-16T12:55:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.932+0000 7feb2e7fc640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 0x7feb1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.932+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7feb2408beb0 con 0x7feb3015c640 2024-04-16T12:55:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.932+0000 7feb35fb0640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 0x7feb1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.933+0000 7feb35fb0640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 0x7feb1c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb28035000 tx=0x7feb28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:56.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:56.937+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb300af880 con 0x7feb3015c640 2024-04-16T12:55:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.124+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feb3015ff00 con 0x7feb3015c640 2024-04-16T12:55:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.124+0000 7feb2e7fc640 1 -- 172.21.15.18:0/2808586072 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7feb24059920 con 0x7feb3015c640 2024-04-16T12:55:57.126 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:57.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 msgr2=0x7feb1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 0x7feb1c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb28035000 tx=0x7feb28008030 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 msgr2=0x7feb30162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c7f0 tx=0x7feb2400ccb0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 shutdown_connections 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feb1c06c8f0 0x7feb1c06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb3015ef80 0x7feb301f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015c640 0x7feb30162710 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 --2- 172.21.15.18:0/2808586072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb3006db00 0x7feb3015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 >> 172.21.15.18:0/2808586072 conn(0x7feb30073550 msgr2=0x7feb300d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 shutdown_connections 2024-04-16T12:55:57.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.126+0000 7feb38214640 1 -- 172.21.15.18:0/2808586072 wait complete. 2024-04-16T12:55:57.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:57.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.244+0000 7f2d7927e640 1 Processor -- start 2024-04-16T12:55:57.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.244+0000 7f2d7927e640 1 -- start start 2024-04-16T12:55:57.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d7927e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d7415ef70 0x7f2d7406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d7927e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d7406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d7927e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d740cfe40 con 0x7f2d740b3ea0 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d7927e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2d740d0120 con 0x7f2d7415ef70 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d7927e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2d740d2470 con 0x7f2d740d3c80 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d72ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d7415ef70 0x7f2d7406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d727fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2d740b3ea0 0x7f2d741628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43452/0 (socket says 172.21.15.18:43452) 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d727fc640 1 -- 172.21.15.18:0/622558740 learned_addr learned my addr 172.21.15.18:0/622558740 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d72ffd640 1 -- 172.21.15.18:0/622558740 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 msgr2=0x7f2d7406bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d737fe640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d7406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d72ffd640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d7406bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d71ffb640 1 -- 172.21.15.18:0/622558740 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874033728 0 0) 0x7f2d740cfe40 con 0x7f2d740b3ea0 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d72ffd640 1 -- 172.21.15.18:0/622558740 >> v1:172.21.15.18:6789/0 conn(0x7f2d740b3ea0 legacy=0x7f2d741628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d72ffd640 1 -- 172.21.15.18:0/622558740 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d740d2750 con 0x7f2d7415ef70 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.245+0000 7f2d737fe640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d7406bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.246+0000 7f2d72ffd640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d7415ef70 0x7f2d7406ba20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009d90 tx=0x7f2d6402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1c2d092b3463ed server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.246+0000 7f2d71ffb640 1 -- 172.21.15.18:0/622558740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64039070 con 0x7f2d7415ef70 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.246+0000 7f2d71ffb640 1 -- 172.21.15.18:0/622558740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6402cc50 con 0x7f2d7415ef70 2024-04-16T12:55:57.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.246+0000 7f2d71ffb640 1 -- 172.21.15.18:0/622558740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64034440 con 0x7f2d7415ef70 2024-04-16T12:55:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 -- 172.21.15.18:0/622558740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d7415ef70 msgr2=0x7f2d7406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d7415ef70 0x7f2d7406ba20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009d90 tx=0x7f2d6402bea0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 -- 172.21.15.18:0/622558740 shutdown_connections 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d7406bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 --2- 172.21.15.18:0/622558740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d7415ef70 0x7f2d7406ba20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 -- 172.21.15.18:0/622558740 >> 172.21.15.18:0/622558740 conn(0x7f2d740b69e0 msgr2=0x7f2d740d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 -- 172.21.15.18:0/622558740 shutdown_connections 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.247+0000 7f2d7927e640 1 -- 172.21.15.18:0/622558740 wait complete. 2024-04-16T12:55:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.248+0000 7f2d7927e640 1 Processor -- start 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.248+0000 7f2d7927e640 1 -- start start 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d740cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d7414d3e0 0x7f2d740ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d740b3510 con 0x7f2d740b3ea0 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2d740b3390 con 0x7f2d7414d3e0 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d7927e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2d740b3690 con 0x7f2d740d3c80 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59700/0 (socket says 172.21.15.18:59700) 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 -- 172.21.15.18:0/1647078522 learned_addr learned my addr 172.21.15.18:0/1647078522 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d727fc640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d740cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 -- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 msgr2=0x7f2d740cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d740cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d737fe640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d7414d3e0 0x7f2d740ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 -- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d7414d3e0 msgr2=0x7f2d740ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d7414d3e0 0x7f2d740ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 -- 172.21.15.18:0/1647078522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7414ded0 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d727fc640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d740cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.249+0000 7f2d72ffd640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2d64037040 tx=0x7f2d64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.250+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64039050 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.250+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64045070 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.250+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6403e850 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.250+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7414e1b0 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.250+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7414e770 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.251+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d740752b0 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.251+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d6402cb10 con 0x7f2d740b3ea0 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.252+0000 7f2d6b7fe640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 0x7f2d5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.252+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2d640ae610 con 0x7f2d740b3ea0 2024-04-16T12:55:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.252+0000 7f2d727fc640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 0x7f2d5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.253+0000 7f2d727fc640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 0x7f2d5406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b6030 tx=0x7f2d5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.256+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d6404e020 con 0x7f2d740b3ea0 2024-04-16T12:55:57.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.440+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2d740b9f60 con 0x7f2d740b3ea0 2024-04-16T12:55:57.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.441+0000 7f2d6b7fe640 1 -- 172.21.15.18:0/1647078522 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2d6407c5a0 con 0x7f2d740b3ea0 2024-04-16T12:55:57.443 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 msgr2=0x7f2d5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 0x7f2d5406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b6030 tx=0x7f2d5c009040 comp rx=0 tx=0).stop 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 msgr2=0x7f2d74151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2d64037040 tx=0x7f2d64004a40 comp rx=0 tx=0).stop 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 shutdown_connections 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2d5406c920 0x7f2d5406ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d7414d3e0 0x7f2d740ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2d740d3c80 0x7f2d740cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 --2- 172.21.15.18:0/1647078522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d740b3ea0 0x7f2d74151320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 >> 172.21.15.18:0/1647078522 conn(0x7f2d740b69e0 msgr2=0x7f2d740b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:57.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 shutdown_connections 2024-04-16T12:55:57.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.443+0000 7f2d7927e640 1 -- 172.21.15.18:0/1647078522 wait complete. 2024-04-16T12:55:57.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-04-16T12:55:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.559+0000 7f93d0b00640 1 Processor -- start 2024-04-16T12:55:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.559+0000 7f93d0b00640 1 -- start start 2024-04-16T12:55:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.560+0000 7f93d0b00640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93cc15c820 0x7f93cc1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.560+0000 7f93d0b00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f93cc0b48c0 0x7f93cc0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.560+0000 7f93d0b00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93cc15cc00 con 0x7f93cc0ccd80 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.560+0000 7f93d0b00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc160a30 con 0x7f93cc0b48c0 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.560+0000 7f93d0b00640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc160d10 con 0x7f93cc15c820 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93cad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f93cc0b48c0 0x7f93cc0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93c9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f93cc0ccd80 0x7f93cc0b41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43458/0 (socket says 172.21.15.18:43458) 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93c9d9b640 1 -- 172.21.15.18:0/3189804050 learned_addr learned my addr 172.21.15.18:0/3189804050 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93ca59c640 1 --2- 172.21.15.18:0/3189804050 >> v2:172.21.15.104:3300/0 conn(0x7f93cc15c820 0x7f93cc1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93cad9d640 1 -- 172.21.15.18:0/3189804050 >> v2:172.21.15.104:3300/0 conn(0x7f93cc15c820 msgr2=0x7f93cc1603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93cad9d640 1 --2- 172.21.15.18:0/3189804050 >> v2:172.21.15.104:3300/0 conn(0x7f93cc15c820 0x7f93cc1603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93cad9d640 1 -- 172.21.15.18:0/3189804050 >> v1:172.21.15.18:6789/0 conn(0x7f93cc0ccd80 legacy=0x7f93cc0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.561+0000 7f93cad9d640 1 -- 172.21.15.18:0/3189804050 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc160ff0 con 0x7f93cc0b48c0 2024-04-16T12:55:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93cad9d640 1 --2- 172.21.15.18:0/3189804050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc0d08c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d02b0 tx=0x7f93bc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfdb1759326c8a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93c959a640 1 -- 172.21.15.18:0/3189804050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc039070 con 0x7f93cc0b48c0 2024-04-16T12:55:57.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93c959a640 1 -- 172.21.15.18:0/3189804050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc02cb60 con 0x7f93cc0b48c0 2024-04-16T12:55:57.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93c959a640 1 -- 172.21.15.18:0/3189804050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc034440 con 0x7f93cc0b48c0 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93d0b00640 1 -- 172.21.15.18:0/3189804050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 msgr2=0x7f93cc0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.562+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3189804050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc0d08c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d02b0 tx=0x7f93bc02bdb0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 -- 172.21.15.18:0/3189804050 shutdown_connections 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3189804050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc0d08c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3189804050 >> v2:172.21.15.104:3300/0 conn(0x7f93cc15c820 0x7f93cc1603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 -- 172.21.15.18:0/3189804050 >> 172.21.15.18:0/3189804050 conn(0x7f93cc0cf1b0 msgr2=0x7f93cc0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:57.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 -- 172.21.15.18:0/3189804050 shutdown_connections 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.563+0000 7f93d0b00640 1 -- 172.21.15.18:0/3189804050 wait complete. 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.564+0000 7f93d0b00640 1 Processor -- start 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.564+0000 7f93d0b00640 1 -- start start 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93cc0ccd80 0x7f93cc14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 0x7f93cc147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0d0e00 con 0x7f93cc0b48c0 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0b8260 con 0x7f93cc0ccd80 2024-04-16T12:55:57.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93d0b00640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f93cc0d0f80 con 0x7f93cc15c820 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59718/0 (socket says 172.21.15.18:59718) 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 -- 172.21.15.18:0/3543422372 learned_addr learned my addr 172.21.15.18:0/3543422372 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93cad9d640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 0x7f93cc147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93c9d9b640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93cc0ccd80 0x7f93cc14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 -- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 msgr2=0x7f93cc147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 0x7f93cc147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 -- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93cc0ccd80 msgr2=0x7f93cc14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93cc0ccd80 0x7f93cc14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 -- 172.21.15.18:0/3543422372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc0c98a0 con 0x7f93cc0b48c0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93cad9d640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 0x7f93cc147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93ca59c640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e8a0 tx=0x7f93c400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4017070 con 0x7f93cc0b48c0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.565+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c400c940 con 0x7f93cc0b48c0 2024-04-16T12:55:57.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.566+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c400cd30 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.566+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc14b6e0 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.566+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc1f6610 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.567+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc068a70 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.567+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93c401a070 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.567+0000 7f93c2ffd640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 0x7f93ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.568+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f93c408be30 con 0x7f93cc0b48c0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.568+0000 7f93c9d9b640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 0x7f93ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.568+0000 7f93c9d9b640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 0x7f93ac06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d36e0 tx=0x7f93b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:57.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.572+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93c4059e60 con 0x7f93cc0b48c0 2024-04-16T12:55:57.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.831+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) -- 0x7f93cc0d30e0 con 0x7f93cc0b48c0 2024-04-16T12:55:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:57.998+0000 7f93c2ffd640 1 -- 172.21.15.18:0/3543422372 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v70) ==== 162+0+0 (secure 0 0 0) 0x7f93c4059760 con 0x7f93cc0b48c0 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 msgr2=0x7f93ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 0x7f93ac06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0d36e0 tx=0x7f93b4009040 comp rx=0 tx=0).stop 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 msgr2=0x7f93cc1f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e8a0 tx=0x7f93c400ed60 comp rx=0 tx=0).stop 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 shutdown_connections 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f93ac06c8f0 0x7f93ac06edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f93cc15c820 0x7f93cc147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93cc0ccd80 0x7f93cc14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 --2- 172.21.15.18:0/3543422372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93cc0b48c0 0x7f93cc1f5d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 >> 172.21.15.18:0/3543422372 conn(0x7f93cc0cf1b0 msgr2=0x7f93cc0b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 shutdown_connections 2024-04-16T12:55:58.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.000+0000 7f93d0b00640 1 -- 172.21.15.18:0/3543422372 wait complete. 2024-04-16T12:55:58.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T12:55:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.119+0000 7f31f290d640 1 Processor -- start 2024-04-16T12:55:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.119+0000 7f31f290d640 1 -- start start 2024-04-16T12:55:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.120+0000 7f31f290d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 0x7f31ec0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.120+0000 7f31f290d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.120+0000 7f31f290d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec06c130 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.120+0000 7f31f290d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f31ec15f030 con 0x7f31ec15ec50 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.120+0000 7f31f290d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec09ac40 con 0x7f31ec06ba20 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31ebfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 0x7f31ec0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:40448/0 (socket says 172.21.15.18:40448) 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 -- 172.21.15.18:0/2139474798 learned_addr learned my addr 172.21.15.18:0/2139474798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31f0eaa640 1 --1- 172.21.15.18:0/2139474798 >> v1:172.21.15.104:6789/0 conn(0x7f31ec0ae7e0 0x7f31ec0b1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:55660/0 (socket says 172.21.15.18:55660) 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 -- 172.21.15.18:0/2139474798 >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 msgr2=0x7f31ec0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 --2- 172.21.15.18:0/2139474798 >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 0x7f31ec0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 -- 172.21.15.18:0/2139474798 >> v1:172.21.15.104:6789/0 conn(0x7f31ec0ae7e0 legacy=0x7f31ec0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31e3fff640 1 -- 172.21.15.18:0/2139474798 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec06be60 con 0x7f31ec06ba20 2024-04-16T12:55:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.121+0000 7f31ebfff640 1 --2- 172.21.15.18:0/2139474798 >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 0x7f31ec0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:58.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31e3fff640 1 --2- 172.21.15.18:0/2139474798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009870 tx=0x7f31d402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8529abc0d171b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31eb7fe640 1 -- 172.21.15.18:0/2139474798 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4034070 con 0x7f31ec06ba20 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31eb7fe640 1 -- 172.21.15.18:0/2139474798 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4030840 con 0x7f31ec06ba20 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31eb7fe640 1 -- 172.21.15.18:0/2139474798 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4030c10 con 0x7f31ec06ba20 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31f290d640 1 -- 172.21.15.18:0/2139474798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 msgr2=0x7f31ec06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.122+0000 7f31f290d640 1 --2- 172.21.15.18:0/2139474798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009870 tx=0x7f31d402b980 comp rx=0 tx=0).stop 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 -- 172.21.15.18:0/2139474798 shutdown_connections 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 --2- 172.21.15.18:0/2139474798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec06ba20 0x7f31ec06d1b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 --2- 172.21.15.18:0/2139474798 >> v2:172.21.15.104:3300/0 conn(0x7f31ec15ec50 0x7f31ec0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 -- 172.21.15.18:0/2139474798 >> 172.21.15.18:0/2139474798 conn(0x7f31ec0735e0 msgr2=0x7f31ec0b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 -- 172.21.15.18:0/2139474798 shutdown_connections 2024-04-16T12:55:58.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.123+0000 7f31f290d640 1 -- 172.21.15.18:0/2139474798 wait complete. 2024-04-16T12:55:58.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 Processor -- start 2024-04-16T12:55:58.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 -- start start 2024-04-16T12:55:58.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31ec06ba20 0x7f31ec156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec15ec50 0x7f31ec1e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec06c9b0 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec06c6d0 con 0x7f31ec06ba20 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.124+0000 7f31f290d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec06cc90 con 0x7f31ec15ec50 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59726/0 (socket says 172.21.15.18:59726) 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 -- 172.21.15.18:0/1630552321 learned_addr learned my addr 172.21.15.18:0/1630552321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31ebfff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31ec06ba20 0x7f31ec156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31f0eaa640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec15ec50 0x7f31ec1e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 -- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec15ec50 msgr2=0x7f31ec1e8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec15ec50 0x7f31ec1e8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 -- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31ec06ba20 msgr2=0x7f31ec156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31ec06ba20 0x7f31ec156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 -- 172.21.15.18:0/1630552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec156950 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e3fff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4048070 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4030640 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec1e7ca0 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4034040 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.125+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec1e8260 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.126+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec0752b0 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.127+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31d4037070 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.127+0000 7f31e97fa640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.127+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f31d40adb80 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.127+0000 7f31ebfff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.128+0000 7f31ebfff640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ec06e620 tx=0x7f31dc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.131+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31ec156950 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.317+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f31ec0682a0 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.320+0000 7f31e97fa640 1 -- 172.21.15.18:0/1630552321 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f31d407b600 con 0x7f31ec0ae7e0 2024-04-16T12:55:58.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 msgr2=0x7f31cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ec06e620 tx=0x7f31dc009190 comp rx=0 tx=0).stop 2024-04-16T12:55:58.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 msgr2=0x7f31ec1e8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c00 tx=0x7f31d4004730 comp rx=0 tx=0).stop 2024-04-16T12:55:58.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 shutdown_connections 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31ec15ec50 0x7f31ec1e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31ec0ae7e0 0x7f31ec1e8980 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 --2- 172.21.15.18:0/1630552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31ec06ba20 0x7f31ec156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 >> 172.21.15.18:0/1630552321 conn(0x7f31ec0735e0 msgr2=0x7f31ec15d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 shutdown_connections 2024-04-16T12:55:58.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.322+0000 7f31f290d640 1 -- 172.21.15.18:0/1630552321 wait complete. 2024-04-16T12:55:58.335 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T12:55:58.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T12:55:58.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T12:55:58.428 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T12:55:58.428 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:58.428 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:58.444 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:58.444 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:58.501 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:55:58.501 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:55:58.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.699+0000 7f3422655640 1 Processor -- start 2024-04-16T12:55:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.699+0000 7f3422655640 1 -- start start 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 0x7f341c0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f341c06ce10 0x7f341c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f341c06ba20 0x7f341c06be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f341c06d7b0 con 0x7f341c06ce10 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f341c06c9a0 con 0x7f341c06ba20 2024-04-16T12:55:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3422655640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f341c06c6c0 con 0x7f341c162240 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f341c06ce10 0x7f341c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f341c06ce10 0x7f341c06d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59728/0 (socket says 172.21.15.18:59728) 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 -- 172.21.15.18:0/124353017 learned_addr learned my addr 172.21.15.18:0/124353017 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341bfff640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 0x7f341c0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f3420bf2640 1 --2- 172.21.15.18:0/124353017 >> v2:172.21.15.104:3300/0 conn(0x7f341c06ba20 0x7f341c06be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 -- 172.21.15.18:0/124353017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 msgr2=0x7f341c0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 0x7f341c0b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 -- 172.21.15.18:0/124353017 >> v2:172.21.15.104:3300/0 conn(0x7f341c06ba20 msgr2=0x7f341c06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 --2- 172.21.15.18:0/124353017 >> v2:172.21.15.104:3300/0 conn(0x7f341c06ba20 0x7f341c06be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341b7fe640 1 -- 172.21.15.18:0/124353017 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c0d2db0 con 0x7f341c06ce10 2024-04-16T12:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.700+0000 7f341bfff640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 0x7f341c0b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.701+0000 7f341b7fe640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ce10 0x7f341c06d270 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f341c0cb860 tx=0x7f341002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e09acf0e24d1a31 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.701+0000 7f341affd640 1 -- 172.21.15.18:0/124353017 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341002e070 con 0x7f341c06ce10 2024-04-16T12:55:58.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.701+0000 7f341affd640 1 -- 172.21.15.18:0/124353017 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3410037070 con 0x7f341c06ce10 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.701+0000 7f341affd640 1 -- 172.21.15.18:0/124353017 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410031a00 con 0x7f341c06ce10 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 -- 172.21.15.18:0/124353017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ce10 msgr2=0x7f341c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ce10 0x7f341c06d270 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f341c0cb860 tx=0x7f341002b880 comp rx=0 tx=0).stop 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 -- 172.21.15.18:0/124353017 shutdown_connections 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 --2- 172.21.15.18:0/124353017 >> v2:172.21.15.104:3300/0 conn(0x7f341c06ba20 0x7f341c06be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ce10 0x7f341c06d270 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 --2- 172.21.15.18:0/124353017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c162240 0x7f341c0b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 -- 172.21.15.18:0/124353017 >> 172.21.15.18:0/124353017 conn(0x7f341c0d48b0 msgr2=0x7f341c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 -- 172.21.15.18:0/124353017 shutdown_connections 2024-04-16T12:55:58.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.702+0000 7f3422655640 1 -- 172.21.15.18:0/124353017 wait complete. 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.703+0000 7f3422655640 1 Processor -- start 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.703+0000 7f3422655640 1 -- start start 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 0x7f341c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f341c162240 0x7f341c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f341c0d3890 con 0x7f341c06ba20 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f341c06c3c0 con 0x7f341c162240 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f341c0d3a10 con 0x7f341c06ce10 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59732/0 (socket says 172.21.15.18:59732) 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 -- 172.21.15.18:0/4219802801 learned_addr learned my addr 172.21.15.18:0/4219802801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341b7fe640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 0x7f341c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3420bf2640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f341c162240 0x7f341c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 -- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 msgr2=0x7f341c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 0x7f341c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 -- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f341c162240 msgr2=0x7f341c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f341c162240 0x7f341c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 -- 172.21.15.18:0/4219802801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c1f8210 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341b7fe640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 0x7f341c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f341bfff640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c7f0 tx=0x7f340c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c015070 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340c007820 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c1f84f0 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.704+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340c007bd0 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.705+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1f8ab0 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.706+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c0752b0 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.706+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f340c018070 con 0x7f341c06ba20 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.706+0000 7f3418ff9640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 0x7f340806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:58.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.706+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f340c08be20 con 0x7f341c06ba20 2024-04-16T12:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.707+0000 7f341b7fe640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 0x7f340806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.707+0000 7f341b7fe640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 0x7f340806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3410036000 tx=0x7f341003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:58.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.711+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f340c059ee0 con 0x7f341c06ba20 2024-04-16T12:55:58.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.898+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f341c0ba2d0 con 0x7f341c06ba20 2024-04-16T12:55:58.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.899+0000 7f3418ff9640 1 -- 172.21.15.18:0/4219802801 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f340c0597e0 con 0x7f341c06ba20 2024-04-16T12:55:58.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:55:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 msgr2=0x7f340806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 0x7f340806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3410036000 tx=0x7f341003d040 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 msgr2=0x7f341c1f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c7f0 tx=0x7f340c00ccb0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 shutdown_connections 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f340806c8f0 0x7f340806edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f341c162240 0x7f341c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f341c06ce10 0x7f341c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 --2- 172.21.15.18:0/4219802801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f341c06ba20 0x7f341c1f51e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 >> 172.21.15.18:0/4219802801 conn(0x7f341c0d48b0 msgr2=0x7f341c0d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 shutdown_connections 2024-04-16T12:55:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:58.901+0000 7f3422655640 1 -- 172.21.15.18:0/4219802801 wait complete. 2024-04-16T12:55:58.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:55:58.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:55:59.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.020+0000 7f885eaeb640 1 Processor -- start 2024-04-16T12:55:59.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.020+0000 7f885eaeb640 1 -- start start 2024-04-16T12:55:59.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.021+0000 7f885eaeb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 0x7f88580b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.021+0000 7f885eaeb640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.021+0000 7f885eaeb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885815d260 con 0x7f885815a510 2024-04-16T12:55:59.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.021+0000 7f885eaeb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f885815dde0 con 0x7f885815cde0 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.021+0000 7f885eaeb640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f885815d540 con 0x7f88580b8380 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:40490/0 (socket says 172.21.15.18:40490) 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 -- 172.21.15.18:0/3035000188 learned_addr learned my addr 172.21.15.18:0/3035000188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f8857fff640 1 --2- 172.21.15.18:0/3035000188 >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 0x7f88580b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 -- 172.21.15.18:0/3035000188 >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 msgr2=0x7f88580b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 --2- 172.21.15.18:0/3035000188 >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 0x7f88580b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 -- 172.21.15.18:0/3035000188 >> v1:172.21.15.104:6789/0 conn(0x7f885815a510 legacy=0x7f88580d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f885d088640 1 -- 172.21.15.18:0/3035000188 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885815d820 con 0x7f88580b8380 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.022+0000 7f8857fff640 1 --2- 172.21.15.18:0/3035000188 >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 0x7f88580b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.023+0000 7f885d088640 1 --2- 172.21.15.18:0/3035000188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8848009870 tx=0x7f884802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f9c4cc31eaa6a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.023+0000 7f88577fe640 1 -- 172.21.15.18:0/3035000188 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848034070 con 0x7f88580b8380 2024-04-16T12:55:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.023+0000 7f88577fe640 1 -- 172.21.15.18:0/3035000188 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8848030840 con 0x7f88580b8380 2024-04-16T12:55:59.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.023+0000 7f88577fe640 1 -- 172.21.15.18:0/3035000188 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848030c10 con 0x7f88580b8380 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 -- 172.21.15.18:0/3035000188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 msgr2=0x7f88580ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 --2- 172.21.15.18:0/3035000188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8848009870 tx=0x7f884802b980 comp rx=0 tx=0).stop 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 -- 172.21.15.18:0/3035000188 shutdown_connections 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 --2- 172.21.15.18:0/3035000188 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f88580b8380 0x7f88580ceea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 --2- 172.21.15.18:0/3035000188 >> v2:172.21.15.104:3300/0 conn(0x7f885815cde0 0x7f88580b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 -- 172.21.15.18:0/3035000188 >> 172.21.15.18:0/3035000188 conn(0x7f88580b41c0 msgr2=0x7f88580b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 -- 172.21.15.18:0/3035000188 shutdown_connections 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.024+0000 7f885eaeb640 1 -- 172.21.15.18:0/3035000188 wait complete. 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.025+0000 7f885eaeb640 1 Processor -- start 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.025+0000 7f885eaeb640 1 -- start start 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f885815a510 0x7f88580c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 0x7f8858158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88580cf560 con 0x7f88580b8380 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88580cf3e0 con 0x7f885815cde0 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f88580cf6e0 con 0x7f885815a510 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59746/0 (socket says 172.21.15.18:59746) 2024-04-16T12:55:59.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 -- 172.21.15.18:0/1249076539 learned_addr learned my addr 172.21.15.18:0/1249076539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f8857fff640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f885815a510 0x7f88580c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885d088640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 0x7f8858158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 -- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f885815a510 msgr2=0x7f88580c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f885815a510 0x7f88580c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 -- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 msgr2=0x7f8858158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 0x7f8858158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 -- 172.21.15.18:0/1249076539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885815bf00 con 0x7f88580b8380 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885d088640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 0x7f8858158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885c887640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f885000c7c0 tx=0x7f885000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850016020 con 0x7f88580b8380 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8850006d50 con 0x7f88580b8380 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.026+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885815c1e0 con 0x7f88580b8380 2024-04-16T12:55:59.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.027+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850003bb0 con 0x7f88580b8380 2024-04-16T12:55:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.027+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885814ed10 con 0x7f88580b8380 2024-04-16T12:55:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.028+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858068a70 con 0x7f88580b8380 2024-04-16T12:55:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.028+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f885000a850 con 0x7f88580b8380 2024-04-16T12:55:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.028+0000 7f88557fa640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 0x7f884406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.029+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f885008bb20 con 0x7f88580b8380 2024-04-16T12:55:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.029+0000 7f8857fff640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 0x7f884406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.029+0000 7f8857fff640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 0x7f884406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f884c009560 tx=0x7f884c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.033+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8850020020 con 0x7f88580b8380 2024-04-16T12:55:59.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.218+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88580c7b50 con 0x7f88580b8380 2024-04-16T12:55:59.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.218+0000 7f88557fa640 1 -- 172.21.15.18:0/1249076539 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8850059be0 con 0x7f88580b8380 2024-04-16T12:55:59.220 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 msgr2=0x7f884406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 0x7f884406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f884c009560 tx=0x7f884c009190 comp rx=0 tx=0).stop 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 msgr2=0x7f885814e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f885000c7c0 tx=0x7f885000cc80 comp rx=0 tx=0).stop 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 shutdown_connections 2024-04-16T12:55:59.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f884406c8f0 0x7f884406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f885815cde0 0x7f8858158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f885815a510 0x7f88580c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 --2- 172.21.15.18:0/1249076539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88580b8380 0x7f885814e680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 >> 172.21.15.18:0/1249076539 conn(0x7f88580b41c0 msgr2=0x7f88580d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 shutdown_connections 2024-04-16T12:55:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.220+0000 7f885eaeb640 1 -- 172.21.15.18:0/1249076539 wait complete. 2024-04-16T12:55:59.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:55:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.340+0000 7fc9ef97c640 1 Processor -- start 2024-04-16T12:55:59.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 -- start start 2024-04-16T12:55:59.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9e80d2040 0x7fc9e80b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 0x7fc9e80b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e80b0f40 con 0x7fc9e8146120 2024-04-16T12:55:59.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e8146500 con 0x7fc9e80d2040 2024-04-16T12:55:59.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ef97c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e806dd90 con 0x7fc9e806e220 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ecf17640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9e80d2040 0x7fc9e80b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.341+0000 7fc9ed718640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc9e8146120 0x7fc9e80b0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43468/0 (socket says 172.21.15.18:43468) 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9ed718640 1 -- 172.21.15.18:0/2286743574 learned_addr learned my addr 172.21.15.18:0/2286743574 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9edf19640 1 --2- 172.21.15.18:0/2286743574 >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 0x7fc9e80b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9ecf17640 1 -- 172.21.15.18:0/2286743574 >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 msgr2=0x7fc9e80b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9ecf17640 1 --2- 172.21.15.18:0/2286743574 >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 0x7fc9e80b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9ecf17640 1 -- 172.21.15.18:0/2286743574 >> v1:172.21.15.18:6789/0 conn(0x7fc9e8146120 legacy=0x7fc9e80b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9ecf17640 1 -- 172.21.15.18:0/2286743574 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e806d460 con 0x7fc9e80d2040 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9e7fff640 1 -- 172.21.15.18:0/2286743574 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277273547 0 0) 0x7fc9e80b0f40 con 0x7fc9e8146120 2024-04-16T12:55:59.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.342+0000 7fc9edf19640 1 --2- 172.21.15.18:0/2286743574 >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 0x7fc9e80b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ecf17640 1 --2- 172.21.15.18:0/2286743574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e80d2040 0x7fc9e80b69c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8072fa0 tx=0x7fc9dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5a24e1c6efa64c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9e7fff640 1 -- 172.21.15.18:0/2286743574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc035020 con 0x7fc9e80d2040 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9e7fff640 1 -- 172.21.15.18:0/2286743574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc031830 con 0x7fc9e80d2040 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9e7fff640 1 -- 172.21.15.18:0/2286743574 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc031c00 con 0x7fc9e80d2040 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 -- 172.21.15.18:0/2286743574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e80d2040 msgr2=0x7fc9e80b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/2286743574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e80d2040 0x7fc9e80b69c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8072fa0 tx=0x7fc9dc02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 -- 172.21.15.18:0/2286743574 shutdown_connections 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/2286743574 >> v2:172.21.15.104:3300/0 conn(0x7fc9e806e220 0x7fc9e80b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/2286743574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e80d2040 0x7fc9e80b69c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 -- 172.21.15.18:0/2286743574 >> 172.21.15.18:0/2286743574 conn(0x7fc9e80b62b0 msgr2=0x7fc9e809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 -- 172.21.15.18:0/2286743574 shutdown_connections 2024-04-16T12:55:59.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.343+0000 7fc9ef97c640 1 -- 172.21.15.18:0/2286743574 wait complete. 2024-04-16T12:55:59.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.344+0000 7fc9ef97c640 1 Processor -- start 2024-04-16T12:55:59.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 -- start start 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9e806e220 0x7fc9e8070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e80d2040 0x7fc9e815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e80ae480 con 0x7fc9e8146120 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e806da20 con 0x7fc9e80d2040 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9ef97c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e80ae600 con 0x7fc9e806e220 2024-04-16T12:55:59.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9edf19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9edf19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59770/0 (socket says 172.21.15.18:59770) 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.345+0000 7fc9edf19640 1 -- 172.21.15.18:0/1022330808 learned_addr learned my addr 172.21.15.18:0/1022330808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9ecf17640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e80d2040 0x7fc9e815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9ed718640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9e806e220 0x7fc9e8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 -- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9e806e220 msgr2=0x7fc9e8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9e806e220 0x7fc9e8070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 -- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e80d2040 msgr2=0x7fc9e815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e80d2040 0x7fc9e815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 -- 172.21.15.18:0/1022330808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e815d7f0 con 0x7fc9e8146120 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9edf19640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009fa0 tx=0x7fc9d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d801a070 con 0x7fc9e8146120 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d8003bb0 con 0x7fc9e8146120 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e815dad0 con 0x7fc9e8146120 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8004030 con 0x7fc9e8146120 2024-04-16T12:55:59.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.346+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e815e090 con 0x7fc9e8146120 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.347+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e8068a70 con 0x7fc9e8146120 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.348+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9d801d070 con 0x7fc9e8146120 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.348+0000 7fc9e5ffb640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 0x7fc9d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.348+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc9d808c220 con 0x7fc9e8146120 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.348+0000 7fc9ed718640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 0x7fc9d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.349+0000 7fc9ed718640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 0x7fc9d406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000f60 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.352+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9d8010070 con 0x7fc9e8146120 2024-04-16T12:55:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.537+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9e8145490 con 0x7fc9e8146120 2024-04-16T12:55:59.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.538+0000 7fc9e5ffb640 1 -- 172.21.15.18:0/1022330808 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fc9d805a2e0 con 0x7fc9e8146120 2024-04-16T12:55:59.540 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:55:59.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 msgr2=0x7fc9d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 0x7fc9d406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0000f60 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 msgr2=0x7fc9e813d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009fa0 tx=0x7fc9d800d560 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 shutdown_connections 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9d406c8f0 0x7fc9d406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9e8146120 0x7fc9e813d350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e80d2040 0x7fc9e815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 --2- 172.21.15.18:0/1022330808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9e806e220 0x7fc9e8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 >> 172.21.15.18:0/1022330808 conn(0x7fc9e80b62b0 msgr2=0x7fc9e80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 shutdown_connections 2024-04-16T12:55:59.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.540+0000 7fc9ef97c640 1 -- 172.21.15.18:0/1022330808 wait complete. 2024-04-16T12:55:59.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:55:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.659+0000 7fb37ee63640 1 Processor -- start 2024-04-16T12:55:59.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.659+0000 7fb37ee63640 1 -- start start 2024-04-16T12:55:59.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37ee63640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb37815eb60 0x7fb378162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37ee63640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 0x7fb3780d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37ee63640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3780b7a60 con 0x7fb3780ba350 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37ee63640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb3780d2f30 con 0x7fb37815eb60 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37ee63640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb37815ef40 con 0x7fb3780cfca0 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37cbff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb37815eb60 0x7fb378162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37cbff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb37815eb60 0x7fb378162630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59780/0 (socket says 172.21.15.18:59780) 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.660+0000 7fb37cbff640 1 -- 172.21.15.18:0/2922690032 learned_addr learned my addr 172.21.15.18:0/2922690032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37d400640 1 --2- 172.21.15.18:0/2922690032 >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 0x7fb3780d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37cbff640 1 -- 172.21.15.18:0/2922690032 >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 msgr2=0x7fb3780d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37cbff640 1 --2- 172.21.15.18:0/2922690032 >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 0x7fb3780d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37cbff640 1 -- 172.21.15.18:0/2922690032 >> v1:172.21.15.104:6789/0 conn(0x7fb3780ba350 legacy=0x7fb3780cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:59.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37cbff640 1 -- 172.21.15.18:0/2922690032 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb378162d30 con 0x7fb37815eb60 2024-04-16T12:55:59.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37d400640 1 --2- 172.21.15.18:0/2922690032 >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 0x7fb3780d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.661+0000 7fb37cbff640 1 --2- 172.21.15.18:0/2922690032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37815eb60 0x7fb378162630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3780cb690 tx=0x7fb37402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9d67c00597f09d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb36f7fe640 1 -- 172.21.15.18:0/2922690032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374035020 con 0x7fb37815eb60 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb36f7fe640 1 -- 172.21.15.18:0/2922690032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374031870 con 0x7fb37815eb60 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb36f7fe640 1 -- 172.21.15.18:0/2922690032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374031c40 con 0x7fb37815eb60 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 -- 172.21.15.18:0/2922690032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37815eb60 msgr2=0x7fb378162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 --2- 172.21.15.18:0/2922690032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37815eb60 0x7fb378162630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3780cb690 tx=0x7fb37402b910 comp rx=0 tx=0).stop 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 -- 172.21.15.18:0/2922690032 shutdown_connections 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 --2- 172.21.15.18:0/2922690032 >> v2:172.21.15.104:3300/0 conn(0x7fb3780cfca0 0x7fb3780d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 --2- 172.21.15.18:0/2922690032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37815eb60 0x7fb378162630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 -- 172.21.15.18:0/2922690032 >> 172.21.15.18:0/2922690032 conn(0x7fb3780b65b0 msgr2=0x7fb3780b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 -- 172.21.15.18:0/2922690032 shutdown_connections 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.662+0000 7fb37ee63640 1 -- 172.21.15.18:0/2922690032 wait complete. 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 Processor -- start 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 -- start start 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3780cfca0 0x7fb37814c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37815eb60 0x7fb3780c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3780ba7b0 con 0x7fb3780ba350 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781632f0 con 0x7fb37815eb60 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.664+0000 7fb37ee63640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb3780d3900 con 0x7fb3780cfca0 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59784/0 (socket says 172.21.15.18:59784) 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 -- 172.21.15.18:0/4281896497 learned_addr learned my addr 172.21.15.18:0/4281896497 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37d400640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37815eb60 0x7fb3780c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb36ffff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3780cfca0 0x7fb37814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 -- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3780cfca0 msgr2=0x7fb37814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3780cfca0 0x7fb37814c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 -- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37815eb60 msgr2=0x7fb3780c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37815eb60 0x7fb3780c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 -- 172.21.15.18:0/4281896497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37814ff70 con 0x7fb3780ba350 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37cbff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb374000c00 tx=0x7fb3740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374040070 con 0x7fb3780ba350 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374030d00 con 0x7fb3780ba350 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3781f8450 con 0x7fb3780ba350 2024-04-16T12:55:59.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374035040 con 0x7fb3780ba350 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.665+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3781f8a10 con 0x7fb3780ba350 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.667+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3780752b0 con 0x7fb3780ba350 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.667+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb37404b060 con 0x7fb3780ba350 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.667+0000 7fb36d7fa640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 0x7fb36406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.667+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb3740adba0 con 0x7fb3780ba350 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.667+0000 7fb36ffff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 0x7fb36406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.668+0000 7fb36ffff640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 0x7fb36406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb3780b8870 tx=0x7fb368007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.671+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb37814ff70 con 0x7fb3780ba350 2024-04-16T12:55:59.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.856+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb3780d25d0 con 0x7fb3780ba350 2024-04-16T12:55:59.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.857+0000 7fb36d7fa640 1 -- 172.21.15.18:0/4281896497 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fb3780b7a60 con 0x7fb3780ba350 2024-04-16T12:55:59.860 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:55:59.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 msgr2=0x7fb36406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 0x7fb36406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb3780b8870 tx=0x7fb368007e30 comp rx=0 tx=0).stop 2024-04-16T12:55:59.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 msgr2=0x7fb37814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb374000c00 tx=0x7fb3740046c0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 shutdown_connections 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb36406c8f0 0x7fb36406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37815eb60 0x7fb3780c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb3780cfca0 0x7fb37814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 --2- 172.21.15.18:0/4281896497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3780ba350 0x7fb37814fa30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 >> 172.21.15.18:0/4281896497 conn(0x7fb3780b65b0 msgr2=0x7fb37806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 shutdown_connections 2024-04-16T12:55:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.859+0000 7fb37ee63640 1 -- 172.21.15.18:0/4281896497 wait complete. 2024-04-16T12:55:59.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:55:59.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.980+0000 7fb4a1093640 1 Processor -- start 2024-04-16T12:55:59.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.980+0000 7fb4a1093640 1 -- start start 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb4a1093640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb49c06c130 0x7fb49c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb4a1093640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 0x7fb49c0d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb4a1093640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb49c163480 con 0x7fb49c15ef70 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb4a1093640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb49c15f350 con 0x7fb49c06c130 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb4a1093640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb49c0d2470 con 0x7fb49c0b3a00 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb49c06c130 0x7fb49c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb49c15ef70 0x7fb49c06ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43472/0 (socket says 172.21.15.18:43472) 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49ad9d640 1 -- 172.21.15.18:0/983381207 learned_addr learned my addr 172.21.15.18:0/983381207 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49b59e640 1 --2- 172.21.15.18:0/983381207 >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 0x7fb49c0d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49259c640 1 -- 172.21.15.18:0/983381207 >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 msgr2=0x7fb49c0d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49259c640 1 --2- 172.21.15.18:0/983381207 >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 0x7fb49c0d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49259c640 1 -- 172.21.15.18:0/983381207 >> v1:172.21.15.18:6789/0 conn(0x7fb49c15ef70 legacy=0x7fb49c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49259c640 1 -- 172.21.15.18:0/983381207 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c163760 con 0x7fb49c06c130 2024-04-16T12:55:59.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49a59c640 1 -- 172.21.15.18:0/983381207 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516284660 0 0) 0x7fb49c163480 con 0x7fb49c15ef70 2024-04-16T12:55:59.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.981+0000 7fb49b59e640 1 --2- 172.21.15.18:0/983381207 >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 0x7fb49c0d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:55:59.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb49259c640 1 --2- 172.21.15.18:0/983381207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c0d2ec0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0d25f0 tx=0x7fb48402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11870e482d594c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb49a59c640 1 -- 172.21.15.18:0/983381207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484035020 con 0x7fb49c06c130 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb49a59c640 1 -- 172.21.15.18:0/983381207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb484031830 con 0x7fb49c06c130 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb49a59c640 1 -- 172.21.15.18:0/983381207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484031c00 con 0x7fb49c06c130 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb4a1093640 1 -- 172.21.15.18:0/983381207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 msgr2=0x7fb49c0d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.982+0000 7fb4a1093640 1 --2- 172.21.15.18:0/983381207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c0d2ec0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0d25f0 tx=0x7fb48402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 -- 172.21.15.18:0/983381207 shutdown_connections 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 --2- 172.21.15.18:0/983381207 >> v2:172.21.15.104:3300/0 conn(0x7fb49c0b3a00 0x7fb49c0d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 --2- 172.21.15.18:0/983381207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c0d2ec0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 -- 172.21.15.18:0/983381207 >> 172.21.15.18:0/983381207 conn(0x7fb49c0b69e0 msgr2=0x7fb49c0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 -- 172.21.15.18:0/983381207 shutdown_connections 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.983+0000 7fb4a1093640 1 -- 172.21.15.18:0/983381207 wait complete. 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.984+0000 7fb4a1093640 1 Processor -- start 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.984+0000 7fb4a1093640 1 -- start start 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb49c0b3a00 0x7fb49c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb49c15ef70 0x7fb49c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c0d5160 con 0x7fb49c06c130 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c0d2a30 con 0x7fb49c15ef70 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb49c0b34b0 con 0x7fb49c0b3a00 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59796/0 (socket says 172.21.15.18:59796) 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 -- 172.21.15.18:0/2528234990 learned_addr learned my addr 172.21.15.18:0/2528234990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49b59e640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb49c15ef70 0x7fb49c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49259c640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb49c0b3a00 0x7fb49c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 -- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb49c0b3a00 msgr2=0x7fb49c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb49c0b3a00 0x7fb49c0c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 -- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb49c15ef70 msgr2=0x7fb49c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb49c15ef70 0x7fb49c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 -- 172.21.15.18:0/2528234990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c0cc3e0 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb49ad9d640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c430 tx=0x7fb48c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0074e0 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0047e0 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c15f4d0 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.985+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004bd0 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.986+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c15f790 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.987+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49c04fe80 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.987+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb48c011070 con 0x7fb49c06c130 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.987+0000 7fb493fff640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 0x7fb47c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:55:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.988+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb48c08bb60 con 0x7fb49c06c130 2024-04-16T12:55:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.988+0000 7fb49259c640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 0x7fb47c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:55:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.988+0000 7fb49259c640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 0x7fb47c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb484036000 tx=0x7fb484008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:55:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:55:59.992+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb49c04fe80 con 0x7fb49c06c130 2024-04-16T12:56:00.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.177+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb49c0752b0 con 0x7fb49c06c130 2024-04-16T12:56:00.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.177+0000 7fb493fff640 1 -- 172.21.15.18:0/2528234990 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fb48c059ba0 con 0x7fb49c06c130 2024-04-16T12:56:00.180 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 msgr2=0x7fb47c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 0x7fb47c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb484036000 tx=0x7fb484008030 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 msgr2=0x7fb49c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c430 tx=0x7fb48c00c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 shutdown_connections 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb47c06c8f0 0x7fb47c06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb49c15ef70 0x7fb49c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb49c0b3a00 0x7fb49c0c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 --2- 172.21.15.18:0/2528234990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb49c06c130 0x7fb49c158000 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 >> 172.21.15.18:0/2528234990 conn(0x7fb49c0b69e0 msgr2=0x7fb49c0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 shutdown_connections 2024-04-16T12:56:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.179+0000 7fb4a1093640 1 -- 172.21.15.18:0/2528234990 wait complete. 2024-04-16T12:56:00.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:56:00.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.295+0000 7f6a2a437640 1 Processor -- start 2024-04-16T12:56:00.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.295+0000 7f6a2a437640 1 -- start start 2024-04-16T12:56:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a2a437640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a240cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a2a437640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2415f100 con 0x7f6a2415ed20 2024-04-16T12:56:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a2a437640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a240cfb30 con 0x7f6a240b3ec0 2024-04-16T12:56:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a2a437640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6a240cf740 con 0x7f6a240b6aa0 2024-04-16T12:56:00.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a23fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6a2415ed20 0x7f6a240d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43478/0 (socket says 172.21.15.18:43478) 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a23fff640 1 -- 172.21.15.18:0/1760701504 learned_addr learned my addr 172.21.15.18:0/1760701504 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a289d4640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a240cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633669449 0 0) 0x7f6a2415f100 con 0x7f6a2415ed20 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a0c003520 con 0x7f6a2415ed20 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.296+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531088972 0 0) 0x7f6a0c003520 con 0x7f6a2415ed20 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 msgr2=0x7f6a240cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a240cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 >> v1:172.21.15.104:6789/0 conn(0x7f6a240b3ec0 legacy=0x7f6a240b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a240cfe10 con 0x7f6a2415ed20 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f6a14001670 con 0x7f6a2415ed20 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 >> v1:172.21.15.18:6789/0 conn(0x7f6a2415ed20 legacy=0x7f6a240d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a0c0039e0 0x7f6a0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0c004d40 0x7f6a0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a240cf740 con 0x7f6a0c004d40 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c00b9f0 con 0x7f6a0c0039e0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c00bbf0 con 0x7f6a240b6aa0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0c004d40 0x7f6a0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a23fff640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a0c0039e0 0x7f6a0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a237fe640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 -- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 msgr2=0x7f6a0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a240b6aa0 0x7f6a0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 -- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a0c0039e0 msgr2=0x7f6a0c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a0c0039e0 0x7f6a0c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.297+0000 7f6a289d4640 1 -- 172.21.15.18:0/1760701504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c003520 con 0x7f6a0c004d40 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.298+0000 7f6a289d4640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0c004d40 0x7f6a0c0051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009a30 tx=0x7f6a0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dddf8dc98a5721 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.298+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c009c10 con 0x7f6a0c004d40 2024-04-16T12:56:00.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.298+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c040070 con 0x7f6a0c004d40 2024-04-16T12:56:00.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.298+0000 7f6a22ffd640 1 -- 172.21.15.18:0/1760701504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c03b630 con 0x7f6a0c004d40 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 -- 172.21.15.18:0/1760701504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0c004d40 msgr2=0x7f6a0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 --2- 172.21.15.18:0/1760701504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0c004d40 0x7f6a0c0051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009a30 tx=0x7f6a0c005830 comp rx=0 tx=0).stop 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a289d4640 1 -- 172.21.15.18:0/1760701504 reap_dead start 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 -- 172.21.15.18:0/1760701504 shutdown_connections 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 -- 172.21.15.18:0/1760701504 >> 172.21.15.18:0/1760701504 conn(0x7f6a240d1390 msgr2=0x7f6a240d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 -- 172.21.15.18:0/1760701504 shutdown_connections 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.299+0000 7f6a2a437640 1 -- 172.21.15.18:0/1760701504 wait complete. 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.300+0000 7f6a2a437640 1 Processor -- start 2024-04-16T12:56:00.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.300+0000 7f6a2a437640 1 -- start start 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a0c004d40 0x7f6a240b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 0x7f6a240c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a240d38e0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6a240cf8e0 con 0x7f6a24155be0 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6a240d00f0 con 0x7f6a0c004d40 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59824/0 (socket says 172.21.15.18:59824) 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 -- 172.21.15.18:0/4048263850 learned_addr learned my addr 172.21.15.18:0/4048263850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a23fff640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a0c004d40 0x7f6a240b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a289d4640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 0x7f6a240c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 -- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a0c004d40 msgr2=0x7f6a240b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a0c004d40 0x7f6a240b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 -- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 msgr2=0x7f6a240c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 0x7f6a240c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 -- 172.21.15.18:0/4048263850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a240cc840 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a289d4640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 0x7f6a240c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a237fe640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800f7c0 tx=0x7f6a1800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a180052e0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a18018070 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.301+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a240ccb20 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.302+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800d970 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.302+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a240cd0e0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.302+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a240752b0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.303+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a1800db10 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.303+0000 7f6a20ff9640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 0x7f6a1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.304+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6a1808bea0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.304+0000 7f6a23fff640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 0x7f6a1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.304+0000 7f6a23fff640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 0x7f6a1006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a14001050 tx=0x7f6a14000f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.308+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a18059ed0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.507+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6a240c7c80 con 0x7f6a240cc3a0 2024-04-16T12:56:00.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.508+0000 7f6a20ff9640 1 -- 172.21.15.18:0/4048263850 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f6a180597d0 con 0x7f6a240cc3a0 2024-04-16T12:56:00.510 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:56:00.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 msgr2=0x7f6a1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 0x7f6a1006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a14001050 tx=0x7f6a14000f80 comp rx=0 tx=0).stop 2024-04-16T12:56:00.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 msgr2=0x7f6a240b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800f7c0 tx=0x7f6a1800fc80 comp rx=0 tx=0).stop 2024-04-16T12:56:00.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 shutdown_connections 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6a1006c8f0 0x7f6a1006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a24155be0 0x7f6a240c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a240cc3a0 0x7f6a240b5080 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 --2- 172.21.15.18:0/4048263850 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6a0c004d40 0x7f6a240b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 >> 172.21.15.18:0/4048263850 conn(0x7f6a240d1390 msgr2=0x7f6a240b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 shutdown_connections 2024-04-16T12:56:00.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.510+0000 7f6a2a437640 1 -- 172.21.15.18:0/4048263850 wait complete. 2024-04-16T12:56:00.529 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T12:56:00.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:00.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-16T12:56:00.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:00.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:00.559 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T12:56:00.617 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:00.617 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:00.636 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:00.636 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:00.700 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:00.701 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:00.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:00.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.863+0000 7f6abf7a8640 1 Processor -- start 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.863+0000 7f6abf7a8640 1 -- start start 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab80d1740 0x7f6ab809b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 0x7f6ab80d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ab809aa10 0x7f6ab809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab80d2480 con 0x7f6ab809aa10 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab80720c0 con 0x7f6ab8071400 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abf7a8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab8070e10 con 0x7f6ab80d1740 2024-04-16T12:56:00.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ab809aa10 0x7f6ab809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ab809aa10 0x7f6ab809aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59838/0 (socket says 172.21.15.18:59838) 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 -- 172.21.15.18:0/2261209975 learned_addr learned my addr 172.21.15.18:0/2261209975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abcd43640 1 --2- 172.21.15.18:0/2261209975 >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 0x7f6ab80d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abd544640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab80d1740 0x7f6ab809b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 -- 172.21.15.18:0/2261209975 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab80d1740 msgr2=0x7f6ab809b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab80d1740 0x7f6ab809b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 -- 172.21.15.18:0/2261209975 >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 msgr2=0x7f6ab80d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2261209975 >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 0x7f6ab80d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abdd45640 1 -- 172.21.15.18:0/2261209975 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab80d0bd0 con 0x7f6ab809aa10 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.864+0000 7f6abcd43640 1 --2- 172.21.15.18:0/2261209975 >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 0x7f6ab80d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:00.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.865+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab809aa10 0x7f6ab809aea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80737d0 tx=0x7f6aa802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad25ef04f649653e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.865+0000 7f6ab7fff640 1 -- 172.21.15.18:0/2261209975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa802ca70 con 0x7f6ab809aa10 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.865+0000 7f6ab7fff640 1 -- 172.21.15.18:0/2261209975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa802cc10 con 0x7f6ab809aa10 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.865+0000 7f6ab7fff640 1 -- 172.21.15.18:0/2261209975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80343f0 con 0x7f6ab809aa10 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2261209975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab809aa10 msgr2=0x7f6ab809aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab809aa10 0x7f6ab809aea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80737d0 tx=0x7f6aa802bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2261209975 shutdown_connections 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2261209975 >> v2:172.21.15.104:3300/0 conn(0x7f6ab8071400 0x7f6ab80d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab809aa10 0x7f6ab809aea0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2261209975 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab80d1740 0x7f6ab809b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2261209975 >> 172.21.15.18:0/2261209975 conn(0x7f6ab80d2600 msgr2=0x7f6ab80d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2261209975 shutdown_connections 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.866+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2261209975 wait complete. 2024-04-16T12:56:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.867+0000 7f6abf7a8640 1 Processor -- start 2024-04-16T12:56:00.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.867+0000 7f6abf7a8640 1 -- start start 2024-04-16T12:56:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab8071400 0x7f6ab80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ab809aa10 0x7f6ab80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab806cb30 con 0x7f6ab80d1740 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80710b0 con 0x7f6ab809aa10 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abf7a8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab80d1b20 con 0x7f6ab8071400 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abdd45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abdd45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59852/0 (socket says 172.21.15.18:59852) 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abdd45640 1 -- 172.21.15.18:0/2479151359 learned_addr learned my addr 172.21.15.18:0/2479151359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abcd43640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ab809aa10 0x7f6ab80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.868+0000 7f6abd544640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab8071400 0x7f6ab80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 -- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab8071400 msgr2=0x7f6ab80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab8071400 0x7f6ab80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 -- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ab809aa10 msgr2=0x7f6ab80c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ab809aa10 0x7f6ab80c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:00.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 -- 172.21.15.18:0/2479151359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab80c9270 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abdd45640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009f40 tx=0x7f6aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8043020 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa803e450 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8009510 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab80c6330 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.869+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab80c68f0 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.870+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab80752b0 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.871+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6aa8046020 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.871+0000 7f6ab5ffb640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 0x7f6aa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.871+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6aa80ae1f0 con 0x7f6ab80d1740 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.871+0000 7f6abd544640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 0x7f6aa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.872+0000 7f6abd544640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 0x7f6aa406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007920 tx=0x7f6ab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:00.875+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6aa804d070 con 0x7f6ab80d1740 2024-04-16T12:56:01.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.064+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ab80b03f0 con 0x7f6ab80d1740 2024-04-16T12:56:01.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.065+0000 7f6ab5ffb640 1 -- 172.21.15.18:0/2479151359 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f6aa807bc60 con 0x7f6ab80d1740 2024-04-16T12:56:01.068 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:01.068 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 msgr2=0x7f6aa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 0x7f6aa406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007920 tx=0x7f6ab0008040 comp rx=0 tx=0).stop 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 msgr2=0x7f6ab81590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009f40 tx=0x7f6aa8004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 shutdown_connections 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6aa406c920 0x7f6aa406ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ab80d1740 0x7f6ab81590e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ab809aa10 0x7f6ab80c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 --2- 172.21.15.18:0/2479151359 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6ab8071400 0x7f6ab80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 >> 172.21.15.18:0/2479151359 conn(0x7f6ab80d2600 msgr2=0x7f6ab80702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 shutdown_connections 2024-04-16T12:56:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.067+0000 7f6abf7a8640 1 -- 172.21.15.18:0/2479151359 wait complete. 2024-04-16T12:56:01.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:56:01.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:56:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.188+0000 7f15e93e2640 1 Processor -- start 2024-04-16T12:56:01.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.188+0000 7f15e93e2640 1 -- start start 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e93e2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f15e40d2ce0 0x7f15e40d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e93e2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15e40b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e93e2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e415f0a0 con 0x7f15e406ce10 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e93e2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f15e40d37a0 con 0x7f15e40d2ce0 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e93e2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15e40d3a80 con 0x7f15e40b7b20 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f15e406ce10 0x7f15e406d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43482/0 (socket says 172.21.15.18:43482) 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e2ffd640 1 -- 172.21.15.18:0/3073914709 learned_addr learned my addr 172.21.15.18:0/3073914709 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15da7fc640 1 --2- 172.21.15.18:0/3073914709 >> v2:172.21.15.104:3300/0 conn(0x7f15e40d2ce0 0x7f15e40d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e37fe640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15e40b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944555633 0 0) 0x7f15e415f0a0 con 0x7f15e406ce10 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d0003520 con 0x7f15e406ce10 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 180371133 0 0) 0x7f15d0003520 con 0x7f15e406ce10 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 msgr2=0x7f15e40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15e40b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 >> v2:172.21.15.104:3300/0 conn(0x7f15e40d2ce0 msgr2=0x7f15e40d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 --2- 172.21.15.18:0/3073914709 >> v2:172.21.15.104:3300/0 conn(0x7f15e40d2ce0 0x7f15e40d3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e40d3d60 con 0x7f15e406ce10 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f15d4001690 con 0x7f15e406ce10 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 >> v1:172.21.15.18:6789/0 conn(0x7f15e406ce10 legacy=0x7f15e406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d00039b0 0x7f15d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15e40d37a0 con 0x7f15d0004800 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15e40d3a80 con 0x7f15d00039b0 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.189+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15d000b9f0 con 0x7f15e40b7b20 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15e2ffd640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d00039b0 0x7f15d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15e37fe640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 -- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 msgr2=0x7f15d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 -- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d00039b0 msgr2=0x7f15d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15d00039b0 0x7f15d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15da7fc640 1 -- 172.21.15.18:0/3073914709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d0003520 con 0x7f15d0004800 2024-04-16T12:56:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.190+0000 7f15e37fe640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40b7b20 0x7f15d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15da7fc640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15d0004c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ac0 tx=0x7f15d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa453b97c58e4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc039070 con 0x7f15d0004800 2024-04-16T12:56:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc02c710 con 0x7f15d0004800 2024-04-16T12:56:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e27fc640 1 -- 172.21.15.18:0/3073914709 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc009690 con 0x7f15d0004800 2024-04-16T12:56:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 -- 172.21.15.18:0/3073914709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 msgr2=0x7f15d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 --2- 172.21.15.18:0/3073914709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15d0004c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ac0 tx=0x7f15d0005830 comp rx=0 tx=0).stop 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e37fe640 1 -- 172.21.15.18:0/3073914709 reap_dead start 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 -- 172.21.15.18:0/3073914709 shutdown_connections 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 -- 172.21.15.18:0/3073914709 >> 172.21.15.18:0/3073914709 conn(0x7f15e40d48d0 msgr2=0x7f15e40d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 -- 172.21.15.18:0/3073914709 shutdown_connections 2024-04-16T12:56:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.191+0000 7f15e93e2640 1 -- 172.21.15.18:0/3073914709 wait complete. 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.193+0000 7f15e93e2640 1 Processor -- start 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.193+0000 7f15e93e2640 1 -- start start 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.193+0000 7f15e93e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.193+0000 7f15e93e2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40cd4d0 0x7f15e41f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15e415d6f0 0x7f15e40d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15e406bc20 con 0x7f15d0004800 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15e40d4320 con 0x7f15e415d6f0 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15e40b7f70 con 0x7f15e40cd4d0 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59870/0 (socket says 172.21.15.18:59870) 2024-04-16T12:56:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 -- 172.21.15.18:0/1251523762 learned_addr learned my addr 172.21.15.18:0/1251523762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e37fe640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15e415d6f0 0x7f15e40d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15da7fc640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40cd4d0 0x7f15e41f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 -- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40cd4d0 msgr2=0x7f15e41f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40cd4d0 0x7f15e41f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 -- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15e415d6f0 msgr2=0x7f15e40d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15e415d6f0 0x7f15e40d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 -- 172.21.15.18:0/1251523762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e40cd950 con 0x7f15d0004800 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e2ffd640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15d4007340 tx=0x7f15d4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400f960 con 0x7f15d0004800 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d4018070 con 0x7f15d0004800 2024-04-16T12:56:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e415dfd0 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400fd40 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.194+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e40cc9f0 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.195+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e40752b0 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.196+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15d401d460 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.196+0000 7f15dbfff640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 0x7f15c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.196+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f15d408bf60 con 0x7f15d0004800 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.196+0000 7f15da7fc640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 0x7f15c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.197+0000 7f15da7fc640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 0x7f15c406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15cc036000 tx=0x7f15cc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.200+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15d4059940 con 0x7f15d0004800 2024-04-16T12:56:01.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.383+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15e40c7f80 con 0x7f15d0004800 2024-04-16T12:56:01.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.383+0000 7f15dbfff640 1 -- 172.21.15.18:0/1251523762 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f15d405dc40 con 0x7f15d0004800 2024-04-16T12:56:01.386 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:56:01.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 msgr2=0x7f15c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 0x7f15c406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15cc036000 tx=0x7f15cc030000 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 msgr2=0x7f15e40ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15d4007340 tx=0x7f15d4007800 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 shutdown_connections 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f15c406c920 0x7f15c406ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15e415d6f0 0x7f15e40d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15e40cd4d0 0x7f15e41f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 --2- 172.21.15.18:0/1251523762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0004800 0x7f15e40ce410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 >> 172.21.15.18:0/1251523762 conn(0x7f15e40d48d0 msgr2=0x7f15e40d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 shutdown_connections 2024-04-16T12:56:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.385+0000 7f15e93e2640 1 -- 172.21.15.18:0/1251523762 wait complete. 2024-04-16T12:56:01.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:56:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.503+0000 7f1170d66640 1 Processor -- start 2024-04-16T12:56:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.503+0000 7f1170d66640 1 -- start start 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.504+0000 7f1170d66640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f116c0b2810 0x7f116c169a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.504+0000 7f1170d66640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0ce2a0 con 0x7f116c06dee0 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.504+0000 7f1170d66640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0ce580 con 0x7f116c06e2c0 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.504+0000 7f1170d66640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f116c0ce860 con 0x7f116c0b2810 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.504+0000 7f116ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f116c0b2810 0x7f116c169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.505+0000 7f116a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f116c06dee0 0x7f116c0b6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43484/0 (socket says 172.21.15.18:43484) 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.505+0000 7f116a59c640 1 -- 172.21.15.18:0/3822402093 learned_addr learned my addr 172.21.15.18:0/3822402093 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.505+0000 7f116ad9d640 1 -- 172.21.15.18:0/3822402093 >> v1:172.21.15.104:6789/0 conn(0x7f116c06e2c0 legacy=0x7f116c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.505+0000 7f116ad9d640 1 -- 172.21.15.18:0/3822402093 >> v1:172.21.15.18:6789/0 conn(0x7f116c06dee0 legacy=0x7f116c0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.505+0000 7f116ad9d640 1 -- 172.21.15.18:0/3822402093 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0ceb40 con 0x7f116c0b2810 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f116ad9d640 1 --2- 172.21.15.18:0/3822402093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c0b2810 0x7f116c169a10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f115c009d90 tx=0x7f115c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16caf9f674d2c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f116959a640 1 -- 172.21.15.18:0/3822402093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c039070 con 0x7f116c0b2810 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f116959a640 1 -- 172.21.15.18:0/3822402093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c02cc60 con 0x7f116c0b2810 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f116959a640 1 -- 172.21.15.18:0/3822402093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c034660 con 0x7f116c0b2810 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 -- 172.21.15.18:0/3822402093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c0b2810 msgr2=0x7f116c169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 --2- 172.21.15.18:0/3822402093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c0b2810 0x7f116c169a10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f115c009d90 tx=0x7f115c02beb0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 -- 172.21.15.18:0/3822402093 shutdown_connections 2024-04-16T12:56:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 --2- 172.21.15.18:0/3822402093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c0b2810 0x7f116c169a10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 -- 172.21.15.18:0/3822402093 >> 172.21.15.18:0/3822402093 conn(0x7f116c09aa10 msgr2=0x7f116c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 -- 172.21.15.18:0/3822402093 shutdown_connections 2024-04-16T12:56:01.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.506+0000 7f1170d66640 1 -- 172.21.15.18:0/3822402093 wait complete. 2024-04-16T12:56:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 Processor -- start 2024-04-16T12:56:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 -- start start 2024-04-16T12:56:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f116c06dee0 0x7f116c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f116c0b2810 0x7f116c161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0cdfb0 con 0x7f116c06e2c0 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0cde30 con 0x7f116c0b2810 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.508+0000 7f1170d66640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0b1b30 con 0x7f116c06dee0 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59880/0 (socket says 172.21.15.18:59880) 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 -- 172.21.15.18:0/3796325507 learned_addr learned my addr 172.21.15.18:0/3796325507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f116a59c640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f116c06dee0 0x7f116c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f116ad9d640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f116c0b2810 0x7f116c161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 -- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f116c06dee0 msgr2=0x7f116c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f116c06dee0 0x7f116c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 -- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f116c0b2810 msgr2=0x7f116c161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f116c0b2810 0x7f116c161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 -- 172.21.15.18:0/3796325507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c09f470 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1169d9b640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f115400c460 tx=0x7f115400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154016020 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1154012870 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154012c60 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c09c0e0 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.509+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c15f5c0 con 0x7f116c06e2c0 2024-04-16T12:56:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.510+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c0b2f00 con 0x7f116c06e2c0 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.511+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1154019020 con 0x7f116c06e2c0 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.511+0000 7f1162ffd640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 0x7f114c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.511+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f115408b810 con 0x7f116c06e2c0 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.511+0000 7f116a59c640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 0x7f114c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.512+0000 7f116a59c640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 0x7f114c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.515+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f116c0b2f00 con 0x7f116c06e2c0 2024-04-16T12:56:01.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.702+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f116c070e90 con 0x7f116c06e2c0 2024-04-16T12:56:01.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.702+0000 7f1162ffd640 1 -- 172.21.15.18:0/3796325507 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1154020070 con 0x7f116c06e2c0 2024-04-16T12:56:01.705 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 msgr2=0x7f114c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 0x7f114c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164007e80 comp rx=0 tx=0).stop 2024-04-16T12:56:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 msgr2=0x7f116c161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f115400c460 tx=0x7f115400c920 comp rx=0 tx=0).stop 2024-04-16T12:56:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 shutdown_connections 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f114c06c8f0 0x7f114c06edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f116c0b2810 0x7f116c161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c06e2c0 0x7f116c161510 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 --2- 172.21.15.18:0/3796325507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f116c06dee0 0x7f116c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 >> 172.21.15.18:0/3796325507 conn(0x7f116c09aa10 msgr2=0x7f116c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 shutdown_connections 2024-04-16T12:56:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.705+0000 7f1170d66640 1 -- 172.21.15.18:0/3796325507 wait complete. 2024-04-16T12:56:01.718 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:56:01.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.826+0000 7f427ba1b640 1 Processor -- start 2024-04-16T12:56:01.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f427ba1b640 1 -- start start 2024-04-16T12:56:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f427ba1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 0x7f427415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f427ba1b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427415d5f0 con 0x7f42740cd550 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f427ba1b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427415d8d0 con 0x7f42740b4100 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f427ba1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f427415d390 con 0x7f42740cd170 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f4278fb6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f42740cd550 0x7f4274160b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43498/0 (socket says 172.21.15.18:43498) 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.827+0000 7f4278fb6640 1 -- 172.21.15.18:0/3292815046 learned_addr learned my addr 172.21.15.18:0/3292815046 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f42797b7640 1 --2- 172.21.15.18:0/3292815046 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 0x7f427415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099755895 0 0) 0x7f427415d5f0 con 0x7f42740cd550 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4260003520 con 0x7f42740cd550 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043806509 0 0) 0x7f427415d8d0 con 0x7f42740b4100 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f42797b7640 1 -- 172.21.15.18:0/3292815046 >> v1:172.21.15.104:6789/0 conn(0x7f42740b4100 legacy=0x7f42740d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f42797b7640 1 -- 172.21.15.18:0/3292815046 >> v1:172.21.15.18:6789/0 conn(0x7f42740cd550 legacy=0x7f4274160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.828+0000 7f42797b7640 1 -- 172.21.15.18:0/3292815046 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427415dbb0 con 0x7f42740cd170 2024-04-16T12:56:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f42797b7640 1 --2- 172.21.15.18:0/3292815046 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 0x7f427415ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42700097d0 tx=0x7f427002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e0e94bc865af24 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270037070 con 0x7f42740cd170 2024-04-16T12:56:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270030510 con 0x7f42740cd170 2024-04-16T12:56:01.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f426bfff640 1 -- 172.21.15.18:0/3292815046 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264001670 con 0x7f42740cd170 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f427ba1b640 1 -- 172.21.15.18:0/3292815046 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 msgr2=0x7f427415ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.829+0000 7f427ba1b640 1 --2- 172.21.15.18:0/3292815046 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 0x7f427415ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42700097d0 tx=0x7f427002b730 comp rx=0 tx=0).stop 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.830+0000 7f427ba1b640 1 -- 172.21.15.18:0/3292815046 shutdown_connections 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.830+0000 7f427ba1b640 1 --2- 172.21.15.18:0/3292815046 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd170 0x7f427415ce50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.830+0000 7f427ba1b640 1 -- 172.21.15.18:0/3292815046 >> 172.21.15.18:0/3292815046 conn(0x7f42740cf100 msgr2=0x7f42740cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.830+0000 7f427ba1b640 1 -- 172.21.15.18:0/3292815046 shutdown_connections 2024-04-16T12:56:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.830+0000 7f427ba1b640 1 -- 172.21.15.18:0/3292815046 wait complete. 2024-04-16T12:56:01.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 Processor -- start 2024-04-16T12:56:01.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 -- start start 2024-04-16T12:56:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42740cd170 0x7f427415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd550 0x7f42740cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.831+0000 7f427ba1b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42740cd9d0 con 0x7f42740b4100 2024-04-16T12:56:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f427ba1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4274161260 con 0x7f42740cd170 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f427ba1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f42740d0960 con 0x7f42740cd550 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59894/0 (socket says 172.21.15.18:59894) 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 -- 172.21.15.18:0/1490824576 learned_addr learned my addr 172.21.15.18:0/1490824576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f4279fb8640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd550 0x7f42740cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f4278fb6640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42740cd170 0x7f427415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 -- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd550 msgr2=0x7f42740cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd550 0x7f42740cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 -- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42740cd170 msgr2=0x7f427415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42740cd170 0x7f427415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 -- 172.21.15.18:0/1490824576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740cc510 con 0x7f42740b4100 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f42797b7640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f427002b770 tx=0x7f42700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270042070 con 0x7f42740b4100 2024-04-16T12:56:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427003e930 con 0x7f42740b4100 2024-04-16T12:56:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427415eb10 con 0x7f42740b4100 2024-04-16T12:56:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.832+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270037040 con 0x7f42740b4100 2024-04-16T12:56:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.833+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427415f0d0 con 0x7f42740b4100 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.834+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4274068a70 con 0x7f42740b4100 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.834+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4270045070 con 0x7f42740b4100 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.834+0000 7f4269ffb640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 0x7f425806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.835+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f42700ade80 con 0x7f42740b4100 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.835+0000 7f4278fb6640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 0x7f425806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.835+0000 7f4278fb6640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 0x7f425806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42740c59c0 tx=0x7f42640018f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:01.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:01.839+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f427007bfd0 con 0x7f42740b4100 2024-04-16T12:56:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.023+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f42740ce260 con 0x7f42740b4100 2024-04-16T12:56:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.023+0000 7f4269ffb640 1 -- 172.21.15.18:0/1490824576 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f427003ed00 con 0x7f42740b4100 2024-04-16T12:56:02.026 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:56:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 msgr2=0x7f425806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 0x7f425806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42740c59c0 tx=0x7f42640018f0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 msgr2=0x7f42740c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f427002b770 tx=0x7f42700046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 shutdown_connections 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f425806c8f0 0x7f425806edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f42740cd550 0x7f42740cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42740cd170 0x7f427415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 --2- 172.21.15.18:0/1490824576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42740b4100 0x7f42740c5480 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 >> 172.21.15.18:0/1490824576 conn(0x7f42740cf100 msgr2=0x7f42740d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 shutdown_connections 2024-04-16T12:56:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.025+0000 7f427ba1b640 1 -- 172.21.15.18:0/1490824576 wait complete. 2024-04-16T12:56:02.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.145+0000 7f698d035640 1 Processor -- start 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.145+0000 7f698d035640 1 -- start start 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.145+0000 7f698d035640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69880d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698d035640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6988163480 con 0x7f698806c130 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698d035640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6988163760 con 0x7f698815ef70 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698d035640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f698815f350 con 0x7f69880b3a00 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f697e59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f698806c130 0x7f69880d2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43514/0 (socket says 172.21.15.18:43514) 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f697e59c640 1 -- 172.21.15.18:0/50211853 learned_addr learned my addr 172.21.15.18:0/50211853 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459948201 0 0) 0x7f6988163480 con 0x7f698806c130 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6974003520 con 0x7f698806c130 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698759e640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69880d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430560672 0 0) 0x7f6974003520 con 0x7f698806c130 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 msgr2=0x7f69880d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69880d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 >> v1:172.21.15.104:6789/0 conn(0x7f698815ef70 legacy=0x7f698806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69880d26c0 con 0x7f698806c130 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f6970001670 con 0x7f698806c130 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 >> v1:172.21.15.18:6789/0 conn(0x7f698806c130 legacy=0x7f69880d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6974003f60 0x7f6974004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6974004d40 0x7f69740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f698815f350 con 0x7f6974003f60 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f697400baa0 con 0x7f6974004d40 2024-04-16T12:56:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f697400bca0 con 0x7f69880b3a00 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f697e59c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6974003f60 0x7f6974004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f698759e640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6974004d40 0x7f69740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.146+0000 7f6986d9d640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 -- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 msgr2=0x7f69740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 -- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6974004d40 msgr2=0x7f69740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6974004d40 0x7f69740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 -- 172.21.15.18:0/50211853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6974003520 con 0x7f6974003f60 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f6986d9d640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f69880b3a00 0x7f69740039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.147+0000 7f697e59c640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6974003f60 0x7f6974004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f697000c210 tx=0x7f6974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9c6597193502f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970007d30 con 0x7f6974003f60 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6970030070 con 0x7f6974003f60 2024-04-16T12:56:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698659c640 1 -- 172.21.15.18:0/50211853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697002cda0 con 0x7f6974003f60 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 -- 172.21.15.18:0/50211853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6974003f60 msgr2=0x7f6974004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 --2- 172.21.15.18:0/50211853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6974003f60 0x7f6974004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f697000c210 tx=0x7f6974005830 comp rx=0 tx=0).stop 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698759e640 1 -- 172.21.15.18:0/50211853 reap_dead start 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 -- 172.21.15.18:0/50211853 shutdown_connections 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 -- 172.21.15.18:0/50211853 >> 172.21.15.18:0/50211853 conn(0x7f69880b69e0 msgr2=0x7f69880d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 -- 172.21.15.18:0/50211853 shutdown_connections 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.148+0000 7f698d035640 1 -- 172.21.15.18:0/50211853 wait complete. 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.149+0000 7f698d035640 1 Processor -- start 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 -- start start 2024-04-16T12:56:02.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 0x7f698814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 0x7f69880cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69880d2a30 con 0x7f698815c770 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f69880d2470 con 0x7f69880ce810 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698d035640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f69880b34b0 con 0x7f6974003f60 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59898/0 (socket says 172.21.15.18:59898) 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.150+0000 7f698759e640 1 -- 172.21.15.18:0/306277269 learned_addr learned my addr 172.21.15.18:0/306277269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f697e59c640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 0x7f69880cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f6986d9d640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 0x7f698814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 -- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 msgr2=0x7f698814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 0x7f698814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 -- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 msgr2=0x7f69880cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 0x7f69880cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 -- 172.21.15.18:0/306277269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69880ccbb0 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f697e59c640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 0x7f69880cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f6986d9d640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 0x7f698814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698759e640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6988162930 tx=0x7f698000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000fde0 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698001d070 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69880cce90 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980015670 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.151+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698814d190 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.152+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698806ba20 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.153+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6980015810 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.153+0000 7f697ffff640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 0x7f696806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.153+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f698008c8c0 con 0x7f698815c770 2024-04-16T12:56:02.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.153+0000 7f6986d9d640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 0x7f696806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.154+0000 7f6986d9d640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 0x7f696806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6978007fd0 tx=0x7f6978009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.157+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f698806ba20 con 0x7f698815c770 2024-04-16T12:56:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.341+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f69880752b0 con 0x7f698815c770 2024-04-16T12:56:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.342+0000 7f697ffff640 1 -- 172.21.15.18:0/306277269 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6980010040 con 0x7f698815c770 2024-04-16T12:56:02.344 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.343+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 msgr2=0x7f696806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.343+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 0x7f696806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6978007fd0 tx=0x7f6978009040 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.343+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 msgr2=0x7f698815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.343+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6988162930 tx=0x7f698000f580 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.343+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 shutdown_connections 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f696806c8f0 0x7f696806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f698815c770 0x7f698815cbf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69880ce810 0x7f69880cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 --2- 172.21.15.18:0/306277269 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6974003f60 0x7f698814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 >> 172.21.15.18:0/306277269 conn(0x7f69880b69e0 msgr2=0x7f69880b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:02.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 shutdown_connections 2024-04-16T12:56:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.344+0000 7f698d035640 1 -- 172.21.15.18:0/306277269 wait complete. 2024-04-16T12:56:02.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:56:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.460+0000 7fd194860640 1 Processor -- start 2024-04-16T12:56:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.460+0000 7fd194860640 1 -- start start 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd194860640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd1900d43d0 0x7fd190169960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd194860640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900b7a60 con 0x7fd190162630 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd194860640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd19015ef40 con 0x7fd19015eb60 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd194860640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd1900d2f30 con 0x7fd1900d43d0 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd185d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd190162630 0x7fd1900cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43524/0 (socket says 172.21.15.18:43524) 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd185d9b640 1 -- 172.21.15.18:0/3144595973 learned_addr learned my addr 172.21.15.18:0/3144595973 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18ed9d640 1 --2- 172.21.15.18:0/3144595973 >> v2:172.21.15.104:3300/0 conn(0x7fd1900d43d0 0x7fd190169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060254544 0 0) 0x7fd178001110 con 0x7fd190162630 2024-04-16T12:56:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd17c003520 con 0x7fd190162630 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 268998208 0 0) 0x7fd17c003520 con 0x7fd190162630 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 >> v2:172.21.15.104:3300/0 conn(0x7fd1900d43d0 msgr2=0x7fd190169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 --2- 172.21.15.18:0/3144595973 >> v2:172.21.15.104:3300/0 conn(0x7fd1900d43d0 0x7fd190169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 >> v1:172.21.15.104:6789/0 conn(0x7fd19015eb60 legacy=0x7fd1900ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd190162a90 con 0x7fd190162630 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fd178001840 con 0x7fd190162630 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 >> v1:172.21.15.18:6789/0 conn(0x7fd190162630 legacy=0x7fd1900cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd17c0039b0 0x7fd17c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 0x7fd17c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c0051c0 0x7fd17c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900d2f30 con 0x7fd17c004800 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00c060 con 0x7fd17c0051c0 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c00c260 con 0x7fd17c0039b0 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.461+0000 7fd185d9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 0x7fd17c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd18e59c640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd17c0039b0 0x7fd17c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd18ed9d640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c0051c0 0x7fd17c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd185d9b640 1 -- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd17c0039b0 msgr2=0x7fd17c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd185d9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd17c0039b0 0x7fd17c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd185d9b640 1 -- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c0051c0 msgr2=0x7fd17c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd185d9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c0051c0 0x7fd17c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd18ed9d640 1 -- 172.21.15.18:0/3144595973 reap_dead start 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.462+0000 7fd185d9b640 1 -- 172.21.15.18:0/3144595973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c003520 con 0x7fd17c004800 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd185d9b640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 0x7fd17c004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c4c0 tx=0x7fd17c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab39ad5e029108f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17800c0e0 con 0x7fd17c004800 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178030070 con 0x7fd17c004800 2024-04-16T12:56:02.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd18dd9b640 1 -- 172.21.15.18:0/3144595973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1780058d0 con 0x7fd17c004800 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 -- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 msgr2=0x7fd17c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 0x7fd17c004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c4c0 tx=0x7fd17c005830 comp rx=0 tx=0).stop 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 -- 172.21.15.18:0/3144595973 shutdown_connections 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 --2- 172.21.15.18:0/3144595973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd17c004800 0x7fd17c004c80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 -- 172.21.15.18:0/3144595973 >> 172.21.15.18:0/3144595973 conn(0x7fd1900b65b0 msgr2=0x7fd1900b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 -- 172.21.15.18:0/3144595973 shutdown_connections 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.463+0000 7fd194860640 1 -- 172.21.15.18:0/3144595973 wait complete. 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.465+0000 7fd194860640 1 Processor -- start 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.465+0000 7fd194860640 1 -- start start 2024-04-16T12:56:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c004800 0x7fd1901606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd1900ca840 0x7fd1900cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1901632f0 con 0x7fd19014bb30 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd190163010 con 0x7fd17c004800 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd1900ba350 con 0x7fd1900ca840 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59928/0 (socket says 172.21.15.18:59928) 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 -- 172.21.15.18:0/611184890 learned_addr learned my addr 172.21.15.18:0/611184890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd18e59c640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c004800 0x7fd1901606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd18ed9d640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd1900ca840 0x7fd1900cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 -- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd1900ca840 msgr2=0x7fd1900cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd1900ca840 0x7fd1900cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 -- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c004800 msgr2=0x7fd1901606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c004800 0x7fd1901606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 -- 172.21.15.18:0/611184890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd190161fc0 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd185d9b640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd178001b40 tx=0x7fd17802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178004bf0 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178000ed0 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd190161ce0 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178007070 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.466+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19015fea0 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.467+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1900cac50 con 0x7fd19014bb30 2024-04-16T12:56:02.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.468+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd178048020 con 0x7fd19014bb30 2024-04-16T12:56:02.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.468+0000 7fd1877fe640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:02.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.468+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd1780ad300 con 0x7fd19014bb30 2024-04-16T12:56:02.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.468+0000 7fd18e59c640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:02.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.469+0000 7fd18e59c640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 0x7fd17006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd180000c00 tx=0x7fd180009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:02.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.472+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd1900cac50 con 0x7fd19014bb30 2024-04-16T12:56:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.669+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1900752b0 con 0x7fd19014bb30 2024-04-16T12:56:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.670+0000 7fd1877fe640 1 -- 172.21.15.18:0/611184890 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fd1900b7a60 con 0x7fd19014bb30 2024-04-16T12:56:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:56:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 msgr2=0x7fd17006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 0x7fd17006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd180000c00 tx=0x7fd180009040 comp rx=0 tx=0).stop 2024-04-16T12:56:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 msgr2=0x7fd1900ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd178001b40 tx=0x7fd17802e070 comp rx=0 tx=0).stop 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 shutdown_connections 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd1900ca840 0x7fd1900cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd19014bb30 0x7fd1900ca300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 --2- 172.21.15.18:0/611184890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd17c004800 0x7fd1901606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.671+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 >> 172.21.15.18:0/611184890 conn(0x7fd1900b65b0 msgr2=0x7fd1900b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.672+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 shutdown_connections 2024-04-16T12:56:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:02.672+0000 7fd194860640 1 -- 172.21.15.18:0/611184890 wait complete. 2024-04-16T12:56:02.685 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T12:56:02.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:02.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-16T12:56:02.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:02.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:02.721 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T12:56:02.807 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:56:02.807 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:02.824 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:56:02.824 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:02.880 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:56:02.880 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:02.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:03.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.079+0000 7f61a6a47640 1 Processor -- start 2024-04-16T12:56:03.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.079+0000 7f61a6a47640 1 -- start start 2024-04-16T12:56:03.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a6a47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f61a006e2c0 0x7f61a00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a6a47640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00b2640 con 0x7f61a015b840 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a6a47640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00b3da0 con 0x7f61a015bc20 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a6a47640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f61a00b28c0 con 0x7f61a006e2c0 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f619ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f61a015b840 0x7f61a006dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43538/0 (socket says 172.21.15.18:43538) 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f619ffff640 1 -- 172.21.15.18:0/2102886228 learned_addr learned my addr 172.21.15.18:0/2102886228 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a4fe4640 1 --2- 172.21.15.18:0/2102886228 >> v2:172.21.15.104:3300/0 conn(0x7f61a006e2c0 0x7f61a00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565912649 0 0) 0x7f6190001110 con 0x7f61a015b840 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f618c005730 con 0x7f61a015b840 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541776276 0 0) 0x7f618c005730 con 0x7f61a015b840 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a4fe4640 1 -- 172.21.15.18:0/2102886228 >> v1:172.21.15.104:6789/0 conn(0x7f61a015bc20 legacy=0x7f61a00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a4fe4640 1 -- 172.21.15.18:0/2102886228 >> v1:172.21.15.18:6789/0 conn(0x7f61a015b840 legacy=0x7f61a006dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.080+0000 7f61a4fe4640 1 -- 172.21.15.18:0/2102886228 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00b2ba0 con 0x7f61a006e2c0 2024-04-16T12:56:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.081+0000 7f61a4fe4640 1 --2- 172.21.15.18:0/2102886228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a006e2c0 0x7f61a00cf190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6198009e10 tx=0x7f6198030190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250ae8a5ca3499a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.081+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619803d070 con 0x7f61a006e2c0 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.081+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6198030cc0 con 0x7f61a006e2c0 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.081+0000 7f619f7fe640 1 -- 172.21.15.18:0/2102886228 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190001840 con 0x7f61a006e2c0 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 -- 172.21.15.18:0/2102886228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a006e2c0 msgr2=0x7f61a00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 --2- 172.21.15.18:0/2102886228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a006e2c0 0x7f61a00cf190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6198009e10 tx=0x7f6198030190 comp rx=0 tx=0).stop 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 -- 172.21.15.18:0/2102886228 shutdown_connections 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 --2- 172.21.15.18:0/2102886228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a006e2c0 0x7f61a00cf190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 -- 172.21.15.18:0/2102886228 >> 172.21.15.18:0/2102886228 conn(0x7f61a009aa10 msgr2=0x7f61a00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 -- 172.21.15.18:0/2102886228 shutdown_connections 2024-04-16T12:56:03.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.082+0000 7f61a6a47640 1 -- 172.21.15.18:0/2102886228 wait complete. 2024-04-16T12:56:03.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.083+0000 7f61a6a47640 1 Processor -- start 2024-04-16T12:56:03.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.083+0000 7f61a6a47640 1 -- start start 2024-04-16T12:56:03.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 0x7f61a00c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 0x7f61a00c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00b39a0 con 0x7f61a006e2c0 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00b3820 con 0x7f61a015b840 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a6a47640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00b3b20 con 0x7f61a00c8690 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59936/0 (socket says 172.21.15.18:59936) 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 -- 172.21.15.18:0/673893628 learned_addr learned my addr 172.21.15.18:0/673893628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f6197fff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 0x7f61a00c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a4fe4640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 0x7f61a00c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 -- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 msgr2=0x7f61a00c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 0x7f61a00c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 -- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 msgr2=0x7f61a00c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 0x7f61a00c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f619ffff640 1 -- 172.21.15.18:0/673893628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00c7bc0 con 0x7f61a006e2c0 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f6197fff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 0x7f61a00c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.084+0000 7f61a4fe4640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 0x7f61a00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f619ffff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f619000c7b0 tx=0x7f619000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190017070 con 0x7f61a006e2c0 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a00c8c00 con 0x7f61a006e2c0 2024-04-16T12:56:03.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6190005af0 con 0x7f61a006e2c0 2024-04-16T12:56:03.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190007070 con 0x7f61a006e2c0 2024-04-16T12:56:03.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.085+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a00c4d80 con 0x7f61a006e2c0 2024-04-16T12:56:03.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.086+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a0068a70 con 0x7f61a006e2c0 2024-04-16T12:56:03.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.086+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f619001a070 con 0x7f61a006e2c0 2024-04-16T12:56:03.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.087+0000 7f619d7fa640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 0x7f618006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.087+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f619008b490 con 0x7f61a006e2c0 2024-04-16T12:56:03.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.087+0000 7f6197fff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 0x7f618006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.088+0000 7f6197fff640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 0x7f618006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61a00c6110 tx=0x7f6188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.091+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61a00b2640 con 0x7f61a006e2c0 2024-04-16T12:56:03.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.278+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61a00ae3f0 con 0x7f61a006e2c0 2024-04-16T12:56:03.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.280+0000 7f619d7fa640 1 -- 172.21.15.18:0/673893628 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f61900594d0 con 0x7f61a006e2c0 2024-04-16T12:56:03.282 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:03.282 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 msgr2=0x7f618006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 0x7f618006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61a00c6110 tx=0x7f6188009040 comp rx=0 tx=0).stop 2024-04-16T12:56:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 msgr2=0x7f61a00cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f619000c7b0 tx=0x7f619000cc70 comp rx=0 tx=0).stop 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 shutdown_connections 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f618006c920 0x7f618006ede0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f61a00c8690 0x7f61a00c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a015b840 0x7f61a00c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 --2- 172.21.15.18:0/673893628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a006e2c0 0x7f61a00cb4c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 >> 172.21.15.18:0/673893628 conn(0x7f61a009aa10 msgr2=0x7f61a0070920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 shutdown_connections 2024-04-16T12:56:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.282+0000 7f61a6a47640 1 -- 172.21.15.18:0/673893628 wait complete. 2024-04-16T12:56:03.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:56:03.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:56:03.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.401+0000 7fd0601a8640 1 Processor -- start 2024-04-16T12:56:03.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.402+0000 7fd0601a8640 1 -- start start 2024-04-16T12:56:03.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.402+0000 7fd0601a8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd0580b3ec0 0x7fd0580cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd0601a8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05815f100 con 0x7fd05815ed20 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd0601a8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0580cfb30 con 0x7fd0580b6390 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd0601a8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd0580cf740 con 0x7fd0580b3ec0 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05df44640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd05815ed20 0x7fd0580d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43552/0 (socket says 172.21.15.18:43552) 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05df44640 1 -- 172.21.15.18:0/2906151139 learned_addr learned my addr 172.21.15.18:0/2906151139 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470680025 0 0) 0x7fd05815f100 con 0x7fd05815ed20 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05d743640 1 --2- 172.21.15.18:0/2906151139 >> v2:172.21.15.104:3300/0 conn(0x7fd0580b3ec0 0x7fd0580cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003520 con 0x7fd05815ed20 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73128835 0 0) 0x7fd044003520 con 0x7fd05815ed20 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 >> v2:172.21.15.104:3300/0 conn(0x7fd0580b3ec0 msgr2=0x7fd0580cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 --2- 172.21.15.18:0/2906151139 >> v2:172.21.15.104:3300/0 conn(0x7fd0580b3ec0 0x7fd0580cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 >> v1:172.21.15.104:6789/0 conn(0x7fd0580b6390 legacy=0x7fd0580b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0580cfe10 con 0x7fd05815ed20 2024-04-16T12:56:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fd054001670 con 0x7fd05815ed20 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 >> v1:172.21.15.18:6789/0 conn(0x7fd05815ed20 legacy=0x7fd0580d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0440039b0 0x7fd044003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0440051c0 0x7fd04400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0580cf740 con 0x7fd044004800 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd04400c060 con 0x7fd0440039b0 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd04400c260 con 0x7fd0440051c0 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05d743640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.403+0000 7fd05df44640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0440039b0 0x7fd044003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05e745640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0440051c0 0x7fd04400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 -- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0440051c0 msgr2=0x7fd04400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0440051c0 0x7fd04400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 -- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0440039b0 msgr2=0x7fd044003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0440039b0 0x7fd044003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 -- 172.21.15.18:0/2906151139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd044003520 con 0x7fd044004800 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05e745640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0440051c0 0x7fd04400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05e745640 1 -- 172.21.15.18:0/2906151139 reap_dead start 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.404+0000 7fd05d743640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd044004c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ac0 tx=0x7fd044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd05636705c912 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048039070 con 0x7fd044004800 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04802c6b0 con 0x7fd044004800 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd05cf42640 1 -- 172.21.15.18:0/2906151139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048009690 con 0x7fd044004800 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 -- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 msgr2=0x7fd044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd044004c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ac0 tx=0x7fd044005830 comp rx=0 tx=0).stop 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 -- 172.21.15.18:0/2906151139 shutdown_connections 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 --2- 172.21.15.18:0/2906151139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd044004c80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 -- 172.21.15.18:0/2906151139 >> 172.21.15.18:0/2906151139 conn(0x7fd0580d1390 msgr2=0x7fd0580d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 -- 172.21.15.18:0/2906151139 shutdown_connections 2024-04-16T12:56:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.405+0000 7fd0601a8640 1 -- 172.21.15.18:0/2906151139 wait complete. 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.406+0000 7fd0601a8640 1 Processor -- start 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.406+0000 7fd0601a8640 1 -- start start 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 0x7fd058160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 0x7fd0580c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0580d38e0 con 0x7fd044004800 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd0580cf8e0 con 0x7fd05815fd00 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd0601a8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd0580d00f0 con 0x7fd0580c8920 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd05df44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd05df44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59952/0 (socket says 172.21.15.18:59952) 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd05df44640 1 -- 172.21.15.18:0/1794760387 learned_addr learned my addr 172.21.15.18:0/1794760387 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd05e745640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 0x7fd0580c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.407+0000 7fd05d743640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 0x7fd058160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 -- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 msgr2=0x7fd0580c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 0x7fd0580c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 -- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 msgr2=0x7fd058160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 0x7fd058160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 -- 172.21.15.18:0/1794760387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd058160850 con 0x7fd044004800 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05e745640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 0x7fd0580c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:03.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05d743640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 0x7fd058160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd05df44640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0540072c0 tx=0x7fd054007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05401a070 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05400f960 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd058160b30 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05400fd10 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.408+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581610f0 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.409+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0580752b0 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.409+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd05401d070 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.410+0000 7fd04e7fc640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 0x7fd03c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.410+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd05408ba70 con 0x7fd044004800 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.410+0000 7fd05d743640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 0x7fd03c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.411+0000 7fd05d743640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 0x7fd03c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd048036000 tx=0x7fd048030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.414+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd054059aa0 con 0x7fd044004800 2024-04-16T12:56:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.598+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd05815e210 con 0x7fd044004800 2024-04-16T12:56:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.599+0000 7fd04e7fc640 1 -- 172.21.15.18:0/1794760387 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fd0540593a0 con 0x7fd044004800 2024-04-16T12:56:03.601 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:56:03.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 msgr2=0x7fd03c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 0x7fd03c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd048036000 tx=0x7fd048030000 comp rx=0 tx=0).stop 2024-04-16T12:56:03.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 msgr2=0x7fd05814ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0540072c0 tx=0x7fd054007780 comp rx=0 tx=0).stop 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 shutdown_connections 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd03c06c8f0 0x7fd03c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd0580c8920 0x7fd0580c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd05815fd00 0x7fd058160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 --2- 172.21.15.18:0/1794760387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044004800 0x7fd05814ca00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 >> 172.21.15.18:0/1794760387 conn(0x7fd0580d1390 msgr2=0x7fd0580b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 shutdown_connections 2024-04-16T12:56:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.601+0000 7fd0601a8640 1 -- 172.21.15.18:0/1794760387 wait complete. 2024-04-16T12:56:03.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:56:03.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.719+0000 7f9430fe2640 1 Processor -- start 2024-04-16T12:56:03.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.719+0000 7f9430fe2640 1 -- start start 2024-04-16T12:56:03.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.720+0000 7f9430fe2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.720+0000 7f9430fe2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c0b2640 0x7f942c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.720+0000 7f9430fe2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942c0ce2a0 con 0x7f942c06dee0 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.720+0000 7f9430fe2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f942c0ce580 con 0x7f942c0b2640 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.720+0000 7f9430fe2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f942c0ce860 con 0x7f942c06e2c0 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c0b2640 0x7f942c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f942c06dee0 0x7f942c0b6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43526/0 (socket says 172.21.15.18:43526) 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c0b2640 0x7f942c0b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44030/0 (socket says 172.21.15.18:44030) 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942a59c640 1 -- 172.21.15.18:0/3242842570 learned_addr learned my addr 172.21.15.18:0/3242842570 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f9429d9b640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 -- 172.21.15.18:0/3242842570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 msgr2=0x7f942c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 -- 172.21.15.18:0/3242842570 >> v1:172.21.15.18:6789/0 conn(0x7f942c06dee0 legacy=0x7f942c0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942ad9d640 1 -- 172.21.15.18:0/3242842570 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0ceb40 con 0x7f942c0b2640 2024-04-16T12:56:03.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.721+0000 7f942959a640 1 -- 172.21.15.18:0/3242842570 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121404042 0 0) 0x7f942c0ce2a0 con 0x7f942c06dee0 2024-04-16T12:56:03.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f942ad9d640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0b0b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9424009d90 tx=0x7f942402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f364bed2e8c8ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f942959a640 1 -- 172.21.15.18:0/3242842570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424039070 con 0x7f942c0b2640 2024-04-16T12:56:03.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f942959a640 1 -- 172.21.15.18:0/3242842570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942402cc50 con 0x7f942c0b2640 2024-04-16T12:56:03.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f942959a640 1 -- 172.21.15.18:0/3242842570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424034440 con 0x7f942c0b2640 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f9430fe2640 1 -- 172.21.15.18:0/3242842570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 msgr2=0x7f942c0b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f9430fe2640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0b0b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9424009d90 tx=0x7f942402bea0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f9430fe2640 1 -- 172.21.15.18:0/3242842570 shutdown_connections 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f9430fe2640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0b0b20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.722+0000 7f9430fe2640 1 --2- 172.21.15.18:0/3242842570 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.723+0000 7f9430fe2640 1 -- 172.21.15.18:0/3242842570 >> 172.21.15.18:0/3242842570 conn(0x7f942c09aa10 msgr2=0x7f942c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.723+0000 7f9430fe2640 1 -- 172.21.15.18:0/3242842570 shutdown_connections 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.723+0000 7f9430fe2640 1 -- 172.21.15.18:0/3242842570 wait complete. 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.724+0000 7f9430fe2640 1 Processor -- start 2024-04-16T12:56:03.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.724+0000 7f9430fe2640 1 -- start start 2024-04-16T12:56:03.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f942c06dee0 0x7f942c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0cdfb0 con 0x7f942c0b2640 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0cde30 con 0x7f942c06dee0 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f942c0b1060 con 0x7f942c06e2c0 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44044/0 (socket says 172.21.15.18:44044) 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 -- 172.21.15.18:0/1333503700 learned_addr learned my addr 172.21.15.18:0/1333503700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942a59c640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f942c06dee0 0x7f942c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9429d9b640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 -- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 msgr2=0x7f942c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 -- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f942c06dee0 msgr2=0x7f942c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f942c06dee0 0x7f942c15de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 -- 172.21.15.18:0/1333503700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0cadc0 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f942ad9d640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9424009d90 tx=0x7f9424004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424044020 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942403a040 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c0cb0a0 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424039050 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.725+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c15f510 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.727+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c068a70 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.727+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9424003990 con 0x7f942c0b2640 2024-04-16T12:56:03.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.727+0000 7f941affd640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:03.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.728+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f94240ae1b0 con 0x7f942c0b2640 2024-04-16T12:56:03.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.728+0000 7f942a59c640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:03.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.728+0000 7f942a59c640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 0x7f940c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f941c000f60 tx=0x7f941c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:03.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.732+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f942404e060 con 0x7f942c0b2640 2024-04-16T12:56:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.917+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f942c0cb5c0 con 0x7f942c0b2640 2024-04-16T12:56:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.918+0000 7f941affd640 1 -- 172.21.15.18:0/1333503700 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f942407bc20 con 0x7f942c0b2640 2024-04-16T12:56:03.920 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 msgr2=0x7f940c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 0x7f940c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f941c000f60 tx=0x7f941c007d50 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 msgr2=0x7f942c0ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9424009d90 tx=0x7f9424004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 shutdown_connections 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b2640 0x7f942c0ca790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f942c06e2c0 0x7f942c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 --2- 172.21.15.18:0/1333503700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f942c06dee0 0x7f942c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.919+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 >> 172.21.15.18:0/1333503700 conn(0x7f942c09aa10 msgr2=0x7f942c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.920+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 shutdown_connections 2024-04-16T12:56:03.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:03.920+0000 7f9430fe2640 1 -- 172.21.15.18:0/1333503700 wait complete. 2024-04-16T12:56:03.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.043+0000 7f362ec4a640 1 Processor -- start 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.043+0000 7f362ec4a640 1 -- start start 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.043+0000 7f362ec4a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f362815eb60 0x7f3628162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.043+0000 7f362ec4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 0x7f36280cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362ec4a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36280b7a60 con 0x7f36280cfad0 2024-04-16T12:56:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362ec4a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f36280d2f30 con 0x7f362815eb60 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362ec4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f362815ef40 con 0x7f36280ba350 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f362815eb60 0x7f3628162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f362815eb60 0x7f3628162630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44056/0 (socket says 172.21.15.18:44056) 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 -- 172.21.15.18:0/3865386799 learned_addr learned my addr 172.21.15.18:0/3865386799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f3627fff640 1 --2- 172.21.15.18:0/3865386799 >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 0x7f36280cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 -- 172.21.15.18:0/3865386799 >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 msgr2=0x7f36280cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 --2- 172.21.15.18:0/3865386799 >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 0x7f36280cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 -- 172.21.15.18:0/3865386799 >> v1:172.21.15.18:6789/0 conn(0x7f36280cfad0 legacy=0x7f362806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f36277fe640 1 -- 172.21.15.18:0/3865386799 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422457984 0 0) 0x7f3620001490 con 0x7f36280cfad0 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f362c9e6640 1 -- 172.21.15.18:0/3865386799 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628162d30 con 0x7f362815eb60 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.044+0000 7f3627fff640 1 --2- 172.21.15.18:0/3865386799 >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 0x7f36280cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f362c9e6640 1 --2- 172.21.15.18:0/3865386799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f362815eb60 0x7f3628162630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f362806e100 tx=0x7f361c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718c735d31a3ac99 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f36277fe640 1 -- 172.21.15.18:0/3865386799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c034070 con 0x7f362815eb60 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f36277fe640 1 -- 172.21.15.18:0/3865386799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c030860 con 0x7f362815eb60 2024-04-16T12:56:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f36277fe640 1 -- 172.21.15.18:0/3865386799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c030c30 con 0x7f362815eb60 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f362ec4a640 1 -- 172.21.15.18:0/3865386799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f362815eb60 msgr2=0x7f3628162630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.045+0000 7f362ec4a640 1 --2- 172.21.15.18:0/3865386799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f362815eb60 0x7f3628162630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f362806e100 tx=0x7f361c02b9a0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 -- 172.21.15.18:0/3865386799 shutdown_connections 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 --2- 172.21.15.18:0/3865386799 >> v2:172.21.15.104:3300/0 conn(0x7f36280ba350 0x7f36280cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 --2- 172.21.15.18:0/3865386799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f362815eb60 0x7f3628162630 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 -- 172.21.15.18:0/3865386799 >> 172.21.15.18:0/3865386799 conn(0x7f36280b65b0 msgr2=0x7f36280b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 -- 172.21.15.18:0/3865386799 shutdown_connections 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.046+0000 7f362ec4a640 1 -- 172.21.15.18:0/3865386799 wait complete. 2024-04-16T12:56:04.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.047+0000 7f362ec4a640 1 Processor -- start 2024-04-16T12:56:04.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.047+0000 7f362ec4a640 1 -- start start 2024-04-16T12:56:04.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36280cfad0 0x7f36281f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 0x7f36281e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36280ba7b0 con 0x7f36280ba350 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f36281632f0 con 0x7f362815eb60 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f36280d43d0 con 0x7f36280cfad0 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44072/0 (socket says 172.21.15.18:44072) 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 -- 172.21.15.18:0/2862044472 learned_addr learned my addr 172.21.15.18:0/2862044472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362d1e7640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 0x7f36281e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f3627fff640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36280cfad0 0x7f36281f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 -- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36280cfad0 msgr2=0x7f36281f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36280cfad0 0x7f36281f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 -- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 msgr2=0x7f36281e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 0x7f36281e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 -- 172.21.15.18:0/2862044472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36280cc000 con 0x7f36280ba350 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362d1e7640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 0x7f36281e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362c9e6640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f361c02b9e0 tx=0x7f361c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c034040 con 0x7f36280ba350 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361c039d90 con 0x7f36280ba350 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36281f8c00 con 0x7f36280ba350 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c043610 con 0x7f36280ba350 2024-04-16T12:56:04.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.048+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36281f91c0 con 0x7f36280ba350 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.050+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36280752b0 con 0x7f36280ba350 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.050+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f361c037070 con 0x7f36280ba350 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.050+0000 7f36257fa640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 0x7f360c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.051+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f361c0ae110 con 0x7f36280ba350 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.051+0000 7f3627fff640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 0x7f360c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.051+0000 7f3627fff640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 0x7f360c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f362815ce60 tx=0x7f3614008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.055+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36280cc000 con 0x7f36280ba350 2024-04-16T12:56:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.243+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f36280b3b30 con 0x7f36280ba350 2024-04-16T12:56:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.243+0000 7f36257fa640 1 -- 172.21.15.18:0/2862044472 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f361c03e070 con 0x7f36280ba350 2024-04-16T12:56:04.245 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:56:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 msgr2=0x7f360c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 0x7f360c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f362815ce60 tx=0x7f3614008040 comp rx=0 tx=0).stop 2024-04-16T12:56:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 msgr2=0x7f362815b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f361c02b9e0 tx=0x7f361c0046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 shutdown_connections 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f360c06c8f0 0x7f360c06edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f362815eb60 0x7f36281e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f36280cfad0 0x7f36281f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 --2- 172.21.15.18:0/2862044472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36280ba350 0x7f362815b980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 >> 172.21.15.18:0/2862044472 conn(0x7f36280b65b0 msgr2=0x7f36280d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 shutdown_connections 2024-04-16T12:56:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.245+0000 7f362ec4a640 1 -- 172.21.15.18:0/2862044472 wait complete. 2024-04-16T12:56:04.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:56:04.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.364+0000 7f38698c5640 1 Processor -- start 2024-04-16T12:56:04.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.364+0000 7f38698c5640 1 -- start start 2024-04-16T12:56:04.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38698c5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f386406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38698c5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38640af160 con 0x7f386406dc00 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38698c5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38640af400 con 0x7f386406bf60 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38698c5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f386406f550 con 0x7f386415e930 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38637fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f386406dc00 0x7f3864070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43540/0 (socket says 172.21.15.18:43540) 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38637fe640 1 -- 172.21.15.18:0/4119955638 learned_addr learned my addr 172.21.15.18:0/4119955638 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f3862ffd640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f386406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514042128 0 0) 0x7f38640af160 con 0x7f386406dc00 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3850003520 con 0x7f386406dc00 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2051588453 0 0) 0x7f3850003520 con 0x7f386406dc00 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 msgr2=0x7f386406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f386406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 >> v1:172.21.15.104:6789/0 conn(0x7f386406bf60 legacy=0x7f38640ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386406f770 con 0x7f386406dc00 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f385c0019f0 con 0x7f386406dc00 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 >> v1:172.21.15.18:6789/0 conn(0x7f386406dc00 legacy=0x7f3864070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f38500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850003f60 0x7f3850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f386406f550 con 0x7f3850004d40 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f385000baa0 con 0x7f3850003f60 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f385000bca0 con 0x7f386415e930 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.365+0000 7f38637fe640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f385a7fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850003f60 0x7f3850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f3862ffd640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f38500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 -- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 msgr2=0x7f38500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f386415e930 0x7f38500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 -- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850003f60 msgr2=0x7f3850004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850003f60 0x7f3850004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 -- 172.21.15.18:0/4119955638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3850003520 con 0x7f3850004d40 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f385a7fc640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850003f60 0x7f3850004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.366+0000 7f38637fe640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3850004d40 0x7f38500051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f385c00a860 tx=0x7f3850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b933a4f4f66ee03 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c00a480 con 0x7f3850004d40 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c034630 con 0x7f3850004d40 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38627fc640 1 -- 172.21.15.18:0/4119955638 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c034aa0 con 0x7f3850004d40 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 -- 172.21.15.18:0/4119955638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3850004d40 msgr2=0x7f38500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 --2- 172.21.15.18:0/4119955638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3850004d40 0x7f38500051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f385c00a860 tx=0x7f3850005830 comp rx=0 tx=0).stop 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38637fe640 1 -- 172.21.15.18:0/4119955638 reap_dead start 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 -- 172.21.15.18:0/4119955638 shutdown_connections 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 -- 172.21.15.18:0/4119955638 >> 172.21.15.18:0/4119955638 conn(0x7f38640b6300 msgr2=0x7f386409aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 -- 172.21.15.18:0/4119955638 shutdown_connections 2024-04-16T12:56:04.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.367+0000 7f38698c5640 1 -- 172.21.15.18:0/4119955638 wait complete. 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.368+0000 7f38698c5640 1 Processor -- start 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 -- start start 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850004d40 0x7f3864158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3864154ce0 0x7f38640b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38640b0e20 con 0x7f3864155160 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f38640aee80 con 0x7f3850004d40 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38698c5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f38640b0fa0 con 0x7f3864154ce0 2024-04-16T12:56:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44088/0 (socket says 172.21.15.18:44088) 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.369+0000 7f38637fe640 1 -- 172.21.15.18:0/1411995201 learned_addr learned my addr 172.21.15.18:0/1411995201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f3862ffd640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850004d40 0x7f3864158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f385a7fc640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3864154ce0 0x7f38640b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 -- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3864154ce0 msgr2=0x7f38640b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3864154ce0 0x7f38640b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 -- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850004d40 msgr2=0x7f3864158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850004d40 0x7f3864158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 -- 172.21.15.18:0/1411995201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38641f8980 con 0x7f3864155160 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38637fe640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f385c00a860 tx=0x7f386406f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c039040 con 0x7f3864155160 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c043070 con 0x7f3864155160 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386415be40 con 0x7f3864155160 2024-04-16T12:56:04.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c00a480 con 0x7f3864155160 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.370+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38641575b0 con 0x7f3864155160 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.371+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38640752b0 con 0x7f3864155160 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.372+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f385c0349e0 con 0x7f3864155160 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.372+0000 7f3860ff9640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.372+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f385c0adb80 con 0x7f3864155160 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.372+0000 7f3862ffd640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.373+0000 7f3862ffd640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 0x7f384406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3854009bc0 tx=0x7f3854009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.376+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f386415be40 con 0x7f3864155160 2024-04-16T12:56:04.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.560+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f386406d8b0 con 0x7f3864155160 2024-04-16T12:56:04.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.560+0000 7f3860ff9640 1 -- 172.21.15.18:0/1411995201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f385c07bc40 con 0x7f3864155160 2024-04-16T12:56:04.563 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 msgr2=0x7f384406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 0x7f384406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3854009bc0 tx=0x7f3854009190 comp rx=0 tx=0).stop 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 msgr2=0x7f38640b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f385c00a860 tx=0x7f386406f940 comp rx=0 tx=0).stop 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 shutdown_connections 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f384406c8f0 0x7f384406edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864155160 0x7f38640b30e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3864154ce0 0x7f38640b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 --2- 172.21.15.18:0/1411995201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3850004d40 0x7f3864158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.562+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 >> 172.21.15.18:0/1411995201 conn(0x7f38640b6300 msgr2=0x7f3864160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.563+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 shutdown_connections 2024-04-16T12:56:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.563+0000 7f38698c5640 1 -- 172.21.15.18:0/1411995201 wait complete. 2024-04-16T12:56:04.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:56:04.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.680+0000 7fe131932640 1 Processor -- start 2024-04-16T12:56:04.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.680+0000 7fe131932640 1 -- start start 2024-04-16T12:56:04.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe131932640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe131932640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe12c0cfca0 0x7fe12c0d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe131932640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe12c0b7a60 con 0x7fe12c0ba350 2024-04-16T12:56:04.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe131932640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe12c0d2f30 con 0x7fe12c0cfca0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe131932640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe12c15ef40 con 0x7fe12c15eb60 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe12c0cfca0 0x7fe12c0d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe12c0cfca0 0x7fe12c0d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44102/0 (socket says 172.21.15.18:44102) 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe12c0ba350 0x7fe12c0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43544/0 (socket says 172.21.15.18:43544) 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 -- 172.21.15.18:0/3206774351 learned_addr learned my addr 172.21.15.18:0/3206774351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12affd640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 -- 172.21.15.18:0/3206774351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 msgr2=0x7fe12c162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe129ffb640 1 -- 172.21.15.18:0/3206774351 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548521493 0 0) 0x7fe114001110 con 0x7fe12c0ba350 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 -- 172.21.15.18:0/3206774351 >> v1:172.21.15.18:6789/0 conn(0x7fe12c0ba350 legacy=0x7fe12c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12b7fe640 1 -- 172.21.15.18:0/3206774351 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c162d30 con 0x7fe12c0cfca0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.681+0000 7fe12affd640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.682+0000 7fe12b7fe640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0d33c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009e50 tx=0x7fe11c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e239c714f842f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.682+0000 7fe129ffb640 1 -- 172.21.15.18:0/3206774351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c02cb00 con 0x7fe12c0cfca0 2024-04-16T12:56:04.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.682+0000 7fe129ffb640 1 -- 172.21.15.18:0/3206774351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe11c02cca0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.682+0000 7fe129ffb640 1 -- 172.21.15.18:0/3206774351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c034610 con 0x7fe12c0cfca0 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 -- 172.21.15.18:0/3206774351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 msgr2=0x7fe12c0d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0d33c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009e50 tx=0x7fe11c02bf60 comp rx=0 tx=0).stop 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 -- 172.21.15.18:0/3206774351 shutdown_connections 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0d33c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 --2- 172.21.15.18:0/3206774351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 -- 172.21.15.18:0/3206774351 >> 172.21.15.18:0/3206774351 conn(0x7fe12c0b65b0 msgr2=0x7fe12c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 -- 172.21.15.18:0/3206774351 shutdown_connections 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.683+0000 7fe131932640 1 -- 172.21.15.18:0/3206774351 wait complete. 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.684+0000 7fe131932640 1 Processor -- start 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.684+0000 7fe131932640 1 -- start start 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 0x7fe12c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c0ba7b0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe12c1632f0 con 0x7fe12c0ba350 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe131932640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe12c0d3900 con 0x7fe12c15eb60 2024-04-16T12:56:04.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44110/0 (socket says 172.21.15.18:44110) 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 -- 172.21.15.18:0/917636107 learned_addr learned my addr 172.21.15.18:0/917636107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12b7fe640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12affd640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 0x7fe12c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 -- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 msgr2=0x7fe12c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 -- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 msgr2=0x7fe12c14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 0x7fe12c14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 -- 172.21.15.18:0/917636107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c0cc8f0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12b7fe640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12affd640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 0x7fe12c14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.685+0000 7fe12a7fc640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c7b0 tx=0x7fe11400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.686+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114018070 con 0x7fe12c0cfca0 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.686+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1140072d0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.686+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140047e0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.686+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12c0cd310 con 0x7fe12c0cfca0 2024-04-16T12:56:04.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.686+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12c0cd8d0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.687+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12c0752b0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.687+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe114004980 con 0x7fe12c0cfca0 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.688+0000 7fe123fff640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.688+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe11408b390 con 0x7fe12c0cfca0 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.688+0000 7fe12affd640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:04.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.689+0000 7fe12affd640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 0x7fe10c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe124006fd0 tx=0x7fe124008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:04.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.692+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe12c0b7a60 con 0x7fe12c0cfca0 2024-04-16T12:56:04.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:04.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.890+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe12c0d25d0 con 0x7fe12c0cfca0 2024-04-16T12:56:04.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.890+0000 7fe123fff640 1 -- 172.21.15.18:0/917636107 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fe114004c70 con 0x7fe12c0cfca0 2024-04-16T12:56:04.893 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 msgr2=0x7fe10c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 0x7fe10c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe124006fd0 tx=0x7fe124008040 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 msgr2=0x7fe12c0ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c7b0 tx=0x7fe11400cc70 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 shutdown_connections 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe12c15eb60 0x7fe12c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe12c0cfca0 0x7fe12c0ce0d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 --2- 172.21.15.18:0/917636107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12c0ba350 0x7fe12c14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:04.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 >> 172.21.15.18:0/917636107 conn(0x7fe12c0b65b0 msgr2=0x7fe12c0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 shutdown_connections 2024-04-16T12:56:04.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:04.892+0000 7fe131932640 1 -- 172.21.15.18:0/917636107 wait complete. 2024-04-16T12:56:04.906 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-16T12:56:04.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:04.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-16T12:56:04.935 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:04.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:04.935 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-16T12:56:04.991 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:04.991 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:05.010 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:05.010 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:05.070 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:05.070 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:05.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:05.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.236+0000 7f9b3400d640 1 Processor -- start 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.236+0000 7f9b3400d640 1 -- start start 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b3400d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b2c0d1740 0x7f9b2c09b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b3400d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b2c0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b3400d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2c070e10 con 0x7f9b2c09aa10 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b3400d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2c0d2480 con 0x7f9b2c0d1740 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b3400d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c0720c0 con 0x7f9b2c071400 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b325aa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9b2c09aa10 0x7f9b2c06d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43548/0 (socket says 172.21.15.18:43548) 2024-04-16T12:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b325aa640 1 -- 172.21.15.18:0/2030994563 learned_addr learned my addr 172.21.15.18:0/2030994563 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.237+0000 7f9b31da9640 1 --2- 172.21.15.18:0/2030994563 >> v2:172.21.15.104:3300/0 conn(0x7f9b2c0d1740 0x7f9b2c09b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b315a8640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b2c0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940151634 0 0) 0x7f9b2c070e10 con 0x7f9b2c09aa10 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b18003520 con 0x7f9b2c09aa10 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1119256631 0 0) 0x7f9b18003520 con 0x7f9b2c09aa10 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 msgr2=0x7f9b2c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b2c0d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 >> v2:172.21.15.104:3300/0 conn(0x7f9b2c0d1740 msgr2=0x7f9b2c09b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 --2- 172.21.15.18:0/2030994563 >> v2:172.21.15.104:3300/0 conn(0x7f9b2c0d1740 0x7f9b2c09b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c0d0bd0 con 0x7f9b2c09aa10 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f9b240019f0 con 0x7f9b2c09aa10 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 >> v1:172.21.15.18:6789/0 conn(0x7f9b2c09aa10 legacy=0x7f9b2c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180039b0 0x7f9b18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b18004800 0x7f9b18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0d2480 con 0x7f9b180039b0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0720c0 con 0x7f9b18004800 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1800b9c0 con 0x7f9b2c071400 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180039b0 0x7f9b18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b315a8640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b18004800 0x7f9b18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b325aa640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 -- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 msgr2=0x7f9b180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c071400 0x7f9b180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 -- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b18004800 msgr2=0x7f9b18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b18004800 0x7f9b18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b31da9640 1 -- 172.21.15.18:0/2030994563 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b18003520 con 0x7f9b180039b0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.238+0000 7f9b315a8640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b18004800 0x7f9b18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.239+0000 7f9b31da9640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180039b0 0x7f9b18003dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009ac0 tx=0x7f9b18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114cc04f469898f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.239+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28039070 con 0x7f9b180039b0 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.239+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2802c710 con 0x7f9b180039b0 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.239+0000 7f9b30da7640 1 -- 172.21.15.18:0/2030994563 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28009690 con 0x7f9b180039b0 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 -- 172.21.15.18:0/2030994563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180039b0 msgr2=0x7f9b18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 --2- 172.21.15.18:0/2030994563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180039b0 0x7f9b18003dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009ac0 tx=0x7f9b18005830 comp rx=0 tx=0).stop 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b325aa640 1 -- 172.21.15.18:0/2030994563 reap_dead start 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 -- 172.21.15.18:0/2030994563 shutdown_connections 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 -- 172.21.15.18:0/2030994563 >> 172.21.15.18:0/2030994563 conn(0x7f9b2c0d2600 msgr2=0x7f9b2c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 -- 172.21.15.18:0/2030994563 shutdown_connections 2024-04-16T12:56:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.240+0000 7f9b3400d640 1 -- 172.21.15.18:0/2030994563 wait complete. 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.241+0000 7f9b3400d640 1 Processor -- start 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.241+0000 7f9b3400d640 1 -- start start 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b180039b0 0x7f9b2c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c09e340 0x7f9b2c09cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c06cb30 con 0x7f9b2c1548e0 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c0710b0 con 0x7f9b180039b0 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b3400d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c0d1b20 con 0x7f9b2c09e340 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44116/0 (socket says 172.21.15.18:44116) 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 -- 172.21.15.18:0/1376032507 learned_addr learned my addr 172.21.15.18:0/1376032507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b31da9640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b180039b0 0x7f9b2c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b315a8640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c09e340 0x7f9b2c09cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 -- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c09e340 msgr2=0x7f9b2c09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c09e340 0x7f9b2c09cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 -- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b180039b0 msgr2=0x7f9b2c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b180039b0 0x7f9b2c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 -- 172.21.15.18:0/1376032507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c1552c0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b325aa640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c073300 tx=0x7f9b2400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400eda0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.242+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b24018070 con 0x7f9b2c1548e0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.243+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c1555a0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.243+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24013660 con 0x7f9b2c1548e0 2024-04-16T12:56:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.243+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c1521f0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.244+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c0752b0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.244+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b24013800 con 0x7f9b2c1548e0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.244+0000 7f9b227fc640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 0x7f9b1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.245+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9b2408c140 con 0x7f9b2c1548e0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.245+0000 7f9b31da9640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 0x7f9b1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.245+0000 7f9b31da9640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 0x7f9b1006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b28036000 tx=0x7f9b28030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.250+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b24059b10 con 0x7f9b2c1548e0 2024-04-16T12:56:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.440+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b2c0008d0 con 0x7f9b2c1548e0 2024-04-16T12:56:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.441+0000 7f9b227fc640 1 -- 172.21.15.18:0/1376032507 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f9b2405de10 con 0x7f9b2c1548e0 2024-04-16T12:56:05.444 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:05.444 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 msgr2=0x7f9b1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 0x7f9b1006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b28036000 tx=0x7f9b28030000 comp rx=0 tx=0).stop 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 msgr2=0x7f9b2c0b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c073300 tx=0x7f9b2400e530 comp rx=0 tx=0).stop 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 shutdown_connections 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9b1006c920 0x7f9b1006ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b2c1548e0 0x7f9b2c0b63a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9b2c09e340 0x7f9b2c09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 --2- 172.21.15.18:0/1376032507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b180039b0 0x7f9b2c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.443+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 >> 172.21.15.18:0/1376032507 conn(0x7f9b2c0d2600 msgr2=0x7f9b2c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:05.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.444+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 shutdown_connections 2024-04-16T12:56:05.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.444+0000 7f9b3400d640 1 -- 172.21.15.18:0/1376032507 wait complete. 2024-04-16T12:56:05.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:56:05.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:56:05.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.562+0000 7f27d7a93640 1 Processor -- start 2024-04-16T12:56:05.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 -- start start 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d015ecc0 0x7f27d009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27d009af50 0x7f27d00d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d00b1b80 con 0x7f27d0070260 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f27d009bfd0 con 0x7f27d009af50 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.563+0000 7f27d7a93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f27d00b1e60 con 0x7f27d015ecc0 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d6030640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27d009af50 0x7f27d00d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d502e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27d0070260 0x7f27d00cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43560/0 (socket says 172.21.15.18:43560) 2024-04-16T12:56:05.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d502e640 1 -- 172.21.15.18:0/2385850773 learned_addr learned my addr 172.21.15.18:0/2385850773 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d582f640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d015ecc0 0x7f27d009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d6030640 1 -- 172.21.15.18:0/2385850773 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d015ecc0 msgr2=0x7f27d009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d6030640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d015ecc0 0x7f27d009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d6030640 1 -- 172.21.15.18:0/2385850773 >> v1:172.21.15.18:6789/0 conn(0x7f27d0070260 legacy=0x7f27d00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d6030640 1 -- 172.21.15.18:0/2385850773 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d009bcf0 con 0x7f27d009af50 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.564+0000 7f27d482d640 1 -- 172.21.15.18:0/2385850773 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340252640 0 0) 0x7f27d00b1b80 con 0x7f27d0070260 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d6030640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d009af50 0x7f27d00d1770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde8852b215f3530 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d482d640 1 -- 172.21.15.18:0/2385850773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8039070 con 0x7f27d009af50 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d482d640 1 -- 172.21.15.18:0/2385850773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c802cc50 con 0x7f27d009af50 2024-04-16T12:56:05.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d482d640 1 -- 172.21.15.18:0/2385850773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8034440 con 0x7f27d009af50 2024-04-16T12:56:05.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 -- 172.21.15.18:0/2385850773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d009af50 msgr2=0x7f27d00d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d009af50 0x7f27d00d1770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c802bea0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 -- 172.21.15.18:0/2385850773 shutdown_connections 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d009af50 0x7f27d00d1770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 --2- 172.21.15.18:0/2385850773 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d015ecc0 0x7f27d009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 -- 172.21.15.18:0/2385850773 >> 172.21.15.18:0/2385850773 conn(0x7f27d00d26d0 msgr2=0x7f27d00d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.565+0000 7f27d7a93640 1 -- 172.21.15.18:0/2385850773 shutdown_connections 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.566+0000 7f27d7a93640 1 -- 172.21.15.18:0/2385850773 wait complete. 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 Processor -- start 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 -- start start 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d009af50 0x7f27d00ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 0x7f27d00b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27d015f220 con 0x7f27d0070260 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27d015f0a0 con 0x7f27d015ecc0 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d7a93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f27d00cd7d0 con 0x7f27d009af50 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d582f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d582f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44140/0 (socket says 172.21.15.18:44140) 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.567+0000 7f27d582f640 1 -- 172.21.15.18:0/466841246 learned_addr learned my addr 172.21.15.18:0/466841246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d502e640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d009af50 0x7f27d00ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d6030640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 0x7f27d00b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 -- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d009af50 msgr2=0x7f27d00ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d009af50 0x7f27d00ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 -- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 msgr2=0x7f27d00b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 0x7f27d00b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 -- 172.21.15.18:0/466841246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d00cb3a0 con 0x7f27d0070260 2024-04-16T12:56:05.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d6030640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 0x7f27d00b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d582f640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e870 tx=0x7f27cc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc017070 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc00c940 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d00cb680 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00cd30 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.568+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d00b56d0 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.569+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d00752b0 con 0x7f27d0070260 2024-04-16T12:56:05.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.570+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27cc01a070 con 0x7f27d0070260 2024-04-16T12:56:05.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.570+0000 7f27c67fc640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 0x7f27b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.570+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f27cc08c0a0 con 0x7f27d0070260 2024-04-16T12:56:05.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.570+0000 7f27d502e640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 0x7f27b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.571+0000 7f27d502e640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 0x7f27b406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27d0070bc0 tx=0x7f27c0007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.575+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f27cc059a80 con 0x7f27d0070260 2024-04-16T12:56:05.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.759+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f27d00cfd20 con 0x7f27d0070260 2024-04-16T12:56:05.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.759+0000 7f27c67fc640 1 -- 172.21.15.18:0/466841246 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f27cc05dd80 con 0x7f27d0070260 2024-04-16T12:56:05.762 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 msgr2=0x7f27b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 0x7f27b406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27d0070bc0 tx=0x7f27c0007d50 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 msgr2=0x7f27d0155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e870 tx=0x7f27cc00ed30 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 shutdown_connections 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f27b406c920 0x7f27b406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27d015ecc0 0x7f27d00b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f27d009af50 0x7f27d00ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 --2- 172.21.15.18:0/466841246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d0070260 0x7f27d0155ba0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 >> 172.21.15.18:0/466841246 conn(0x7f27d00d26d0 msgr2=0x7f27d00d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:05.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 shutdown_connections 2024-04-16T12:56:05.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.762+0000 7f27d7a93640 1 -- 172.21.15.18:0/466841246 wait complete. 2024-04-16T12:56:05.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.879+0000 7f0bbfceb640 1 Processor -- start 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 -- start start 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0bb8144f30 0x7f0bb80b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb806d140 0x7f0bb815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb80b3ee0 con 0x7f0bb80cd910 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb80b4af0 con 0x7f0bb8144f30 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.880+0000 7f0bbfceb640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb80b41c0 con 0x7f0bb806d140 2024-04-16T12:56:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0bb8144f30 0x7f0bb80b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0bb8144f30 0x7f0bb80b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44150/0 (socket says 172.21.15.18:44150) 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 -- 172.21.15.18:0/977981082 learned_addr learned my addr 172.21.15.18:0/977981082 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbe288640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb806d140 0x7f0bb815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 -- 172.21.15.18:0/977981082 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb806d140 msgr2=0x7f0bb815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb806d140 0x7f0bb815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 -- 172.21.15.18:0/977981082 >> v1:172.21.15.104:6789/0 conn(0x7f0bb80cd910 legacy=0x7f0bb806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.881+0000 7f0bbda87640 1 -- 172.21.15.18:0/977981082 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80b44a0 con 0x7f0bb8144f30 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbda87640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb8144f30 0x7f0bb80b4f80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009870 tx=0x7f0bb402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cff459862723bd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbca85640 1 -- 172.21.15.18:0/977981082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4034070 con 0x7f0bb8144f30 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbca85640 1 -- 172.21.15.18:0/977981082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb4030840 con 0x7f0bb8144f30 2024-04-16T12:56:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbca85640 1 -- 172.21.15.18:0/977981082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4030c10 con 0x7f0bb8144f30 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 -- 172.21.15.18:0/977981082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb8144f30 msgr2=0x7f0bb80b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb8144f30 0x7f0bb80b4f80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009870 tx=0x7f0bb402b980 comp rx=0 tx=0).stop 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 -- 172.21.15.18:0/977981082 shutdown_connections 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb806d140 0x7f0bb815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/977981082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb8144f30 0x7f0bb80b4f80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 -- 172.21.15.18:0/977981082 >> 172.21.15.18:0/977981082 conn(0x7f0bb8071f70 msgr2=0x7f0bb8072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 -- 172.21.15.18:0/977981082 shutdown_connections 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.882+0000 7f0bbfceb640 1 -- 172.21.15.18:0/977981082 wait complete. 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 Processor -- start 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- start start 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80cd910 0x7f0bb80aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb8144f30 0x7f0bb8142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8145310 con 0x7f0bb806d140 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80b37e0 con 0x7f0bb80cd910 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb8145490 con 0x7f0bb8144f30 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44158/0 (socket says 172.21.15.18:44158) 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 -- 172.21.15.18:0/2119099726 learned_addr learned my addr 172.21.15.18:0/2119099726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbe288640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb8144f30 0x7f0bb8142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbd286640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80cd910 0x7f0bb80aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 -- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb8144f30 msgr2=0x7f0bb8142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb8144f30 0x7f0bb8142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 -- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80cd910 msgr2=0x7f0bb80aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80cd910 0x7f0bb80aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 -- 172.21.15.18:0/2119099726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb813ee60 con 0x7f0bb806d140 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbda87640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4000c00 tx=0x7f0bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4034040 con 0x7f0bb806d140 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb4039d90 con 0x7f0bb806d140 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4043630 con 0x7f0bb806d140 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb813f140 con 0x7f0bb806d140 2024-04-16T12:56:05.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.885+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb813f700 con 0x7f0bb806d140 2024-04-16T12:56:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.886+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb813f940 con 0x7f0bb806d140 2024-04-16T12:56:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.887+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bb404a060 con 0x7f0bb806d140 2024-04-16T12:56:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.887+0000 7f0bae7fc640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 0x7f0b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:05.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.887+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0bb40add90 con 0x7f0bb806d140 2024-04-16T12:56:05.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.887+0000 7f0bbd286640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 0x7f0b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:05.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.888+0000 7f0bbd286640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 0x7f0b9c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80b5210 tx=0x7f0ba8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:05.892+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bb403e070 con 0x7f0bb806d140 2024-04-16T12:56:06.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.077+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0bb80752b0 con 0x7f0bb806d140 2024-04-16T12:56:06.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.078+0000 7f0bae7fc640 1 -- 172.21.15.18:0/2119099726 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f0bb407b800 con 0x7f0bb806d140 2024-04-16T12:56:06.080 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 msgr2=0x7f0b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 0x7f0b9c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0bb80b5210 tx=0x7f0ba8009040 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 msgr2=0x7f0bb813e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4000c00 tx=0x7f0bb40046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 shutdown_connections 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b9c06c8f0 0x7f0b9c06edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0bb8144f30 0x7f0bb8142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80cd910 0x7f0bb80aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 --2- 172.21.15.18:0/2119099726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bb806d140 0x7f0bb813e880 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 >> 172.21.15.18:0/2119099726 conn(0x7f0bb8071f70 msgr2=0x7f0bb80b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 shutdown_connections 2024-04-16T12:56:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.080+0000 7f0bbfceb640 1 -- 172.21.15.18:0/2119099726 wait complete. 2024-04-16T12:56:06.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:56:06.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.198+0000 7f6c0b7e9640 1 Processor -- start 2024-04-16T12:56:06.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 -- start start 2024-04-16T12:56:06.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c040b0c50 0x7f6c0406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c0406e6a0 con 0x7f6c0406e270 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6c0406da80 con 0x7f6c040b0c50 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.199+0000 7f6c0b7e9640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040d0be0 con 0x7f6c0415ee90 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c09585640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c08d84640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c040b0c50 0x7f6c0406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c09d86640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6c0406e270 0x7f6c040b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:32788/0 (socket says 172.21.15.18:32788) 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c09585640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:49168/0 (socket says 172.21.15.18:49168) 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c09d86640 1 -- 172.21.15.18:0/3688100491 learned_addr learned my addr 172.21.15.18:0/3688100491 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c08d84640 1 -- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 msgr2=0x7f6c0406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c08d84640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c08d84640 1 -- 172.21.15.18:0/3688100491 >> v1:172.21.15.104:6789/0 conn(0x7f6c0406e270 legacy=0x7f6c040b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c08d84640 1 -- 172.21.15.18:0/3688100491 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c040d0ec0 con 0x7f6c040b0c50 2024-04-16T12:56:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.200+0000 7f6c09585640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c08d84640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c040b0c50 0x7f6c0406dd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097a0 tx=0x7f6bf402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410519e7e7bc3cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6bfbfff640 1 -- 172.21.15.18:0/3688100491 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4035020 con 0x7f6c040b0c50 2024-04-16T12:56:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6bfbfff640 1 -- 172.21.15.18:0/3688100491 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf4031830 con 0x7f6c040b0c50 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6bfbfff640 1 -- 172.21.15.18:0/3688100491 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4031c00 con 0x7f6c040b0c50 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c040b0c50 msgr2=0x7f6c0406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c040b0c50 0x7f6c0406dd30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097a0 tx=0x7f6bf402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/3688100491 shutdown_connections 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c040b0c50 0x7f6c0406dd30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/3688100491 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c0415ee90 0x7f6c0406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.201+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/3688100491 >> 172.21.15.18:0/3688100491 conn(0x7f6c0409aa10 msgr2=0x7f6c040b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.202+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/3688100491 shutdown_connections 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.202+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/3688100491 wait complete. 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 Processor -- start 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- start start 2024-04-16T12:56:06.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c040b0c50 0x7f6c041f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c0415ee90 0x7f6c041f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040b3d70 con 0x7f6c0406e270 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040b3a90 con 0x7f6c0415ee90 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0415f270 con 0x7f6c040b0c50 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c08d84640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c040b0c50 0x7f6c041f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44166/0 (socket says 172.21.15.18:44166) 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 -- 172.21.15.18:0/341802548 learned_addr learned my addr 172.21.15.18:0/341802548 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09d86640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c0415ee90 0x7f6c041f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 -- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c040b0c50 msgr2=0x7f6c041f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c040b0c50 0x7f6c041f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 -- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c0415ee90 msgr2=0x7f6c041f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c0415ee90 0x7f6c041f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 -- 172.21.15.18:0/341802548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0415a410 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c09585640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e960 tx=0x7f6c0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00017070 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0000ca00 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c040c6740 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000cdd0 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.204+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c040ccd50 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.205+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c040d0190 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.206+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c0001a070 con 0x7f6c0406e270 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.206+0000 7f6bf9ffb640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 0x7f6be806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.206+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6c0008c110 con 0x7f6c0406e270 2024-04-16T12:56:06.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.206+0000 7f6c08d84640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 0x7f6be806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.207+0000 7f6c08d84640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 0x7f6be806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4036000 tx=0x7f6bf4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.211+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c040d0190 con 0x7f6c0406e270 2024-04-16T12:56:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.396+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c040af460 con 0x7f6c0406e270 2024-04-16T12:56:06.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.396+0000 7f6bf9ffb640 1 -- 172.21.15.18:0/341802548 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f6c00059af0 con 0x7f6c0406e270 2024-04-16T12:56:06.400 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 msgr2=0x7f6be806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 0x7f6be806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4036000 tx=0x7f6bf4008030 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 msgr2=0x7f6c04159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e960 tx=0x7f6c0000ee20 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 shutdown_connections 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6be806c8f0 0x7f6be806edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c0415ee90 0x7f6c041f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6c040b0c50 0x7f6c041f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 --2- 172.21.15.18:0/341802548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c0406e270 0x7f6c04159ed0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 >> 172.21.15.18:0/341802548 conn(0x7f6c0409aa10 msgr2=0x7f6c0415dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 shutdown_connections 2024-04-16T12:56:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.398+0000 7f6c0b7e9640 1 -- 172.21.15.18:0/341802548 wait complete. 2024-04-16T12:56:06.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:56:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.516+0000 7f64a16f2640 1 Processor -- start 2024-04-16T12:56:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.516+0000 7f64a16f2640 1 -- start start 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f64a16f2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f64a16f2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f649c0b2530 0x7f649c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f64a16f2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649c160480 con 0x7f649c0ced20 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f64a16f2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f649c0aedd0 con 0x7f649c0b2530 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f64a16f2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f649c0b3c00 con 0x7f649c0b15d0 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f649b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f649c0b2530 0x7f649c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f649affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f649c0ced20 0x7f649c0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43576/0 (socket says 172.21.15.18:43576) 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.517+0000 7f649affd640 1 -- 172.21.15.18:0/2448158689 learned_addr learned my addr 172.21.15.18:0/2448158689 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649a7fc640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649b7fe640 1 -- 172.21.15.18:0/2448158689 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 msgr2=0x7f649c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649b7fe640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649b7fe640 1 -- 172.21.15.18:0/2448158689 >> v1:172.21.15.18:6789/0 conn(0x7f649c0ced20 legacy=0x7f649c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649b7fe640 1 -- 172.21.15.18:0/2448158689 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c0b3ee0 con 0x7f649c0b2530 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f6499ffb640 1 -- 172.21.15.18:0/2448158689 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191168571 0 0) 0x7f649c160480 con 0x7f649c0ced20 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.518+0000 7f649b7fe640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0b2530 0x7f649c0ccd30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f649402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3aaef99c81e56b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f6499ffb640 1 -- 172.21.15.18:0/2448158689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494034070 con 0x7f649c0b2530 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f6499ffb640 1 -- 172.21.15.18:0/2448158689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494030610 con 0x7f649c0b2530 2024-04-16T12:56:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f6499ffb640 1 -- 172.21.15.18:0/2448158689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940309e0 con 0x7f649c0b2530 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 -- 172.21.15.18:0/2448158689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0b2530 msgr2=0x7f649c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0b2530 0x7f649c0ccd30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f649402b960 comp rx=0 tx=0).stop 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 -- 172.21.15.18:0/2448158689 shutdown_connections 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0b2530 0x7f649c0ccd30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 --2- 172.21.15.18:0/2448158689 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 -- 172.21.15.18:0/2448158689 >> 172.21.15.18:0/2448158689 conn(0x7f649c09aa10 msgr2=0x7f649c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 -- 172.21.15.18:0/2448158689 shutdown_connections 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.519+0000 7f64a16f2640 1 -- 172.21.15.18:0/2448158689 wait complete. 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.520+0000 7f64a16f2640 1 Processor -- start 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 -- start start 2024-04-16T12:56:06.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f649c0b2530 0x7f649c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f649c0b39a0 con 0x7f649c0ced20 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f649c0b3820 con 0x7f649c0b2530 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f64a16f2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f649c0af8a0 con 0x7f649c0b15d0 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f649b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f649b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44192/0 (socket says 172.21.15.18:44192) 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f649b7fe640 1 -- 172.21.15.18:0/1449028782 learned_addr learned my addr 172.21.15.18:0/1449028782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.521+0000 7f649affd640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649a7fc640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f649c0b2530 0x7f649c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 -- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 msgr2=0x7f649c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 -- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f649c0b2530 msgr2=0x7f649c0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f649c0b2530 0x7f649c0c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 -- 172.21.15.18:0/1449028782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c0c5d70 con 0x7f649c0ced20 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f649b7fe640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f64940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494049070 con 0x7f649c0ced20 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494030410 con 0x7f649c0ced20 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c0c6050 con 0x7f649c0ced20 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494034040 con 0x7f649c0ced20 2024-04-16T12:56:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.522+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c0c6610 con 0x7f649c0ced20 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.523+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c068a70 con 0x7f649c0ced20 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.524+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f649404c070 con 0x7f649c0ced20 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.524+0000 7f64937fe640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 0x7f647c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.524+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f64940adab0 con 0x7f649c0ced20 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.524+0000 7f649affd640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 0x7f647c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.525+0000 7f649affd640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 0x7f647c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f648c0012e0 tx=0x7f648c001630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.528+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64940305e0 con 0x7f649c0ced20 2024-04-16T12:56:06.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.714+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f649c0c7350 con 0x7f649c0ced20 2024-04-16T12:56:06.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.715+0000 7f64937fe640 1 -- 172.21.15.18:0/1449028782 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f649407b490 con 0x7f649c0ced20 2024-04-16T12:56:06.716 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.716+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 msgr2=0x7f647c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.716+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 0x7f647c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f648c0012e0 tx=0x7f648c001630 comp rx=0 tx=0).stop 2024-04-16T12:56:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.716+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 msgr2=0x7f649c0ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.716+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f64940046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 shutdown_connections 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f647c06c8f0 0x7f647c06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c0ced20 0x7f649c0ca470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f649c0b2530 0x7f649c0c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 --2- 172.21.15.18:0/1449028782 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f649c0b15d0 0x7f649c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 >> 172.21.15.18:0/1449028782 conn(0x7f649c09aa10 msgr2=0x7f649c0b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 shutdown_connections 2024-04-16T12:56:06.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.717+0000 7f64a16f2640 1 -- 172.21.15.18:0/1449028782 wait complete. 2024-04-16T12:56:06.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T12:56:06.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.834+0000 7fb335782640 1 Processor -- start 2024-04-16T12:56:06.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.834+0000 7fb335782640 1 -- start start 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb335782640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb330162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb335782640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3300cfca0 0x7fb3300d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb335782640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3300b7a60 con 0x7fb3300ba350 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb335782640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb3300d2f30 con 0x7fb3300cfca0 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb335782640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb33015ef40 con 0x7fb33015eb60 2024-04-16T12:56:06.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3300cfca0 0x7fb3300d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3300cfca0 0x7fb3300d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44206/0 (socket says 172.21.15.18:44206) 2024-04-16T12:56:06.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 -- 172.21.15.18:0/761068655 learned_addr learned my addr 172.21.15.18:0/761068655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:06.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32effd640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb330162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 -- 172.21.15.18:0/761068655 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 msgr2=0x7fb330162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:06.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb330162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 -- 172.21.15.18:0/761068655 >> v1:172.21.15.104:6789/0 conn(0x7fb3300ba350 legacy=0x7fb3300cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.835+0000 7fb32f7fe640 1 -- 172.21.15.18:0/761068655 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb330162d30 con 0x7fb3300cfca0 2024-04-16T12:56:06.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.836+0000 7fb32f7fe640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3300d33c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb328009870 tx=0x7fb32802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc14558e05cf3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.836+0000 7fb32dffb640 1 -- 172.21.15.18:0/761068655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328034070 con 0x7fb3300cfca0 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.836+0000 7fb32dffb640 1 -- 172.21.15.18:0/761068655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb328030840 con 0x7fb3300cfca0 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.836+0000 7fb32dffb640 1 -- 172.21.15.18:0/761068655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328030c10 con 0x7fb3300cfca0 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 -- 172.21.15.18:0/761068655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 msgr2=0x7fb3300d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3300d33c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb328009870 tx=0x7fb32802b980 comp rx=0 tx=0).stop 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 -- 172.21.15.18:0/761068655 shutdown_connections 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3300d33c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 --2- 172.21.15.18:0/761068655 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb330162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 -- 172.21.15.18:0/761068655 >> 172.21.15.18:0/761068655 conn(0x7fb3300b65b0 msgr2=0x7fb3300b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:06.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 -- 172.21.15.18:0/761068655 shutdown_connections 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.837+0000 7fb335782640 1 -- 172.21.15.18:0/761068655 wait complete. 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.838+0000 7fb335782640 1 Processor -- start 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.838+0000 7fb335782640 1 -- start start 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3300ba350 0x7fb3300ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb33015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3300ba7b0 con 0x7fb3300cfca0 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301632f0 con 0x7fb3300ba350 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb335782640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb3300d3900 con 0x7fb33015eb60 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44218/0 (socket says 172.21.15.18:44218) 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 -- 172.21.15.18:0/1025794819 learned_addr learned my addr 172.21.15.18:0/1025794819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32effd640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3300ba350 0x7fb3300ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32f7fe640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb33015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 -- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 msgr2=0x7fb33015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb33015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 -- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3300ba350 msgr2=0x7fb3300ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3300ba350 0x7fb3300ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.839+0000 7fb32e7fc640 1 -- 172.21.15.18:0/1025794819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3301f8690 con 0x7fb3300cfca0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb32e7fc640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c430 tx=0x7fb31800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3180052d0 con 0x7fb3300cfca0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb318005490 con 0x7fb3300cfca0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3301f8970 con 0x7fb3300cfca0 2024-04-16T12:56:06.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318007260 con 0x7fb3300cfca0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.840+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3300cab50 con 0x7fb3300cfca0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.841+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3300752b0 con 0x7fb3300cfca0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.841+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb318007400 con 0x7fb3300cfca0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.842+0000 7fb3277fe640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 0x7fb31006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.842+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb31808b370 con 0x7fb3300cfca0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.842+0000 7fb32effd640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 0x7fb31006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:06.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.842+0000 7fb32effd640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 0x7fb31006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb320011340 tx=0x7fb32000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:06.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:06.846+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3300b7a60 con 0x7fb3300cfca0 2024-04-16T12:56:07.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.044+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb3300d25d0 con 0x7fb3300cfca0 2024-04-16T12:56:07.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.044+0000 7fb3277fe640 1 -- 172.21.15.18:0/1025794819 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb318058de0 con 0x7fb3300cfca0 2024-04-16T12:56:07.046 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 msgr2=0x7fb31006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 0x7fb31006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb320011340 tx=0x7fb32000b040 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 msgr2=0x7fb3301f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c430 tx=0x7fb31800c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 shutdown_connections 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb31006c8f0 0x7fb31006edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb33015eb60 0x7fb33015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3300cfca0 0x7fb3301f7d20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 --2- 172.21.15.18:0/1025794819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3300ba350 0x7fb3300ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 >> 172.21.15.18:0/1025794819 conn(0x7fb3300b65b0 msgr2=0x7fb3300d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 shutdown_connections 2024-04-16T12:56:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.046+0000 7fb335782640 1 -- 172.21.15.18:0/1025794819 wait complete. 2024-04-16T12:56:07.059 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-16T12:56:07.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:07.059 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-16T12:56:07.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:07.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:07.092 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-16T12:56:07.149 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T12:56:07.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:07.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.253+0000 7f964944a640 1 Processor -- start 2024-04-16T12:56:07.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.253+0000 7f964944a640 1 -- start start 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f964944a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 0x7f96440d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f964944a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f964944a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96440d2d90 con 0x7f964415eca0 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f964944a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f964415f080 con 0x7f96440b37e0 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f964944a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f96440d3070 con 0x7f96440d4370 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96427fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 0x7f96440d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:49230/0 (socket says 172.21.15.18:49230) 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96427fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 0x7f96440d3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:60080/0 (socket says 172.21.15.18:60080) 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 -- 172.21.15.18:0/1351167280 learned_addr learned my addr 172.21.15.18:0/1351167280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 -- 172.21.15.18:0/1351167280 >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 msgr2=0x7f96440d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 --2- 172.21.15.18:0/1351167280 >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 0x7f96440d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 -- 172.21.15.18:0/1351167280 >> v1:172.21.15.104:6789/0 conn(0x7f964415eca0 legacy=0x7f964406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.254+0000 7f96437fe640 1 -- 172.21.15.18:0/1351167280 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96440d3350 con 0x7f96440d4370 2024-04-16T12:56:07.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.255+0000 7f96437fe640 1 --2- 172.21.15.18:0/1351167280 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f963c009870 tx=0x7f963c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57278e3c6f70957 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.255+0000 7f9641ffb640 1 -- 172.21.15.18:0/1351167280 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c02f840 con 0x7f96440d4370 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.255+0000 7f9641ffb640 1 -- 172.21.15.18:0/1351167280 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c02f9e0 con 0x7f96440d4370 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.255+0000 7f9641ffb640 1 -- 172.21.15.18:0/1351167280 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c02fdb0 con 0x7f96440d4370 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 -- 172.21.15.18:0/1351167280 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 msgr2=0x7f964406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 --2- 172.21.15.18:0/1351167280 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f963c009870 tx=0x7f963c02ba20 comp rx=0 tx=0).stop 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 -- 172.21.15.18:0/1351167280 shutdown_connections 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 --2- 172.21.15.18:0/1351167280 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f964406ce10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 --2- 172.21.15.18:0/1351167280 >> v2:172.21.15.104:3300/0 conn(0x7f96440b37e0 0x7f96440d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 -- 172.21.15.18:0/1351167280 >> 172.21.15.18:0/1351167280 conn(0x7f96440d48b0 msgr2=0x7f96440d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 -- 172.21.15.18:0/1351167280 shutdown_connections 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.256+0000 7f964944a640 1 -- 172.21.15.18:0/1351167280 wait complete. 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.257+0000 7f964944a640 1 Processor -- start 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.257+0000 7f964944a640 1 -- start start 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 0x7f964414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f96440cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f964406d350 con 0x7f964415eca0 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f96440d3910 con 0x7f96440b37e0 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f964944a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f964406d4d0 con 0x7f96440d4370 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f96437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f96437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44226/0 (socket says 172.21.15.18:44226) 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f96437fe640 1 -- 172.21.15.18:0/784501905 learned_addr learned my addr 172.21.15.18:0/784501905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f96427fc640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f96440cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.258+0000 7f9642ffd640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 0x7f964414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 -- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 msgr2=0x7f96440cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f96440cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 -- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 msgr2=0x7f964414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 0x7f964414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 -- 172.21.15.18:0/784501905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96441f8360 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96427fc640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f96440cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f9642ffd640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 0x7f964414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f96437fe640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963c009870 tx=0x7f963c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c037c40 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c046070 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96441f8640 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c041400 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.259+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96440cbb20 con 0x7f964415eca0 2024-04-16T12:56:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.260+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96441f8b60 con 0x7f964415eca0 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.260+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f963c040070 con 0x7f964415eca0 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.261+0000 7f963b7fe640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 0x7f962406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.261+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f963c0ae5d0 con 0x7f964415eca0 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.261+0000 7f9642ffd640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 0x7f962406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.262+0000 7f9642ffd640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 0x7f962406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96340012e0 tx=0x7f9634009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.265+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96441f8b60 con 0x7f964415eca0 2024-04-16T12:56:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.491+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96440752b0 con 0x7f964415eca0 2024-04-16T12:56:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.491+0000 7f963b7fe640 1 -- 172.21.15.18:0/784501905 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f963c033030 con 0x7f964415eca0 2024-04-16T12:56:07.493 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:07.493 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:56:07.493 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:56:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 msgr2=0x7f962406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 0x7f962406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96340012e0 tx=0x7f9634009040 comp rx=0 tx=0).stop 2024-04-16T12:56:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 msgr2=0x7f96441f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f963c009870 tx=0x7f963c004730 comp rx=0 tx=0).stop 2024-04-16T12:56:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 shutdown_connections 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f962406c8f0 0x7f962406edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964415eca0 0x7f96441f7c60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96440d4370 0x7f96440cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 --2- 172.21.15.18:0/784501905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96440b37e0 0x7f964414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 >> 172.21.15.18:0/784501905 conn(0x7f96440d48b0 msgr2=0x7f96440b97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 shutdown_connections 2024-04-16T12:56:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.493+0000 7f964944a640 1 -- 172.21.15.18:0/784501905 wait complete. 2024-04-16T12:56:07.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.609+0000 7f7c60500640 1 Processor -- start 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.609+0000 7f7c60500640 1 -- start start 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c5815eca0 0x7f7c5806c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 0x7f7c580d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 0x7f7c5806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5815f080 con 0x7f7c5815eca0 2024-04-16T12:56:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7c580d2d90 con 0x7f7c580b37e0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c60500640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580d3070 con 0x7f7c580d4370 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c5815eca0 0x7f7c5806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c5815eca0 0x7f7c5806c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44228/0 (socket says 172.21.15.18:44228) 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 -- 172.21.15.18:0/1467054776 learned_addr learned my addr 172.21.15.18:0/1467054776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5da9b640 1 --2- 172.21.15.18:0/1467054776 >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 0x7f7c580d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5ea9d640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 0x7f7c5806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 -- 172.21.15.18:0/1467054776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 msgr2=0x7f7c5806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 0x7f7c5806ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 -- 172.21.15.18:0/1467054776 >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 msgr2=0x7f7c580d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/1467054776 >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 0x7f7c580d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5e29c640 1 -- 172.21.15.18:0/1467054776 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c580d3350 con 0x7f7c5815eca0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5ea9d640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 0x7f7c5806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.610+0000 7f7c5da9b640 1 --2- 172.21.15.18:0/1467054776 >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 0x7f7c580d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.611+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c5806c430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c58069180 tx=0x7f7c5402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b6eb0315253117 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.611+0000 7f7c5d29a640 1 -- 172.21.15.18:0/1467054776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5402cb00 con 0x7f7c5815eca0 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.611+0000 7f7c5d29a640 1 -- 172.21.15.18:0/1467054776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5402cca0 con 0x7f7c5815eca0 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.611+0000 7f7c5d29a640 1 -- 172.21.15.18:0/1467054776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54034610 con 0x7f7c5815eca0 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 -- 172.21.15.18:0/1467054776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 msgr2=0x7f7c5806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c5806c430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c58069180 tx=0x7f7c5402bf60 comp rx=0 tx=0).stop 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 -- 172.21.15.18:0/1467054776 shutdown_connections 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 --2- 172.21.15.18:0/1467054776 >> v2:172.21.15.104:3300/0 conn(0x7f7c580b37e0 0x7f7c580d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580d4370 0x7f7c5806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 --2- 172.21.15.18:0/1467054776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c5806c430 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 -- 172.21.15.18:0/1467054776 >> 172.21.15.18:0/1467054776 conn(0x7f7c580d48b0 msgr2=0x7f7c580d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 -- 172.21.15.18:0/1467054776 shutdown_connections 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.612+0000 7f7c60500640 1 -- 172.21.15.18:0/1467054776 wait complete. 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.613+0000 7f7c60500640 1 Processor -- start 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.613+0000 7f7c60500640 1 -- start start 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 0x7f7c5815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 0x7f7c581e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5806c970 con 0x7f7c5815eca0 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580d3910 con 0x7f7c580d4370 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c60500640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5806d350 con 0x7f7c580b37e0 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44244/0 (socket says 172.21.15.18:44244) 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 -- 172.21.15.18:0/2022150017 learned_addr learned my addr 172.21.15.18:0/2022150017 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 0x7f7c5815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5da9b640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 0x7f7c581e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 -- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 msgr2=0x7f7c5815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 0x7f7c5815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 -- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 msgr2=0x7f7c581e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 0x7f7c581e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 -- 172.21.15.18:0/2022150017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c581f46f0 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 0x7f7c5815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5da9b640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 0x7f7c581e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c5ea9d640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000e7e0 tx=0x7f7c5000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000f040 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.614+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c50004030 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.615+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c581ea1b0 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.615+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500043e0 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.615+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c581ea770 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.616+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c580752b0 con 0x7f7c5815eca0 2024-04-16T12:56:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.616+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c5000c6d0 con 0x7f7c5815eca0 2024-04-16T12:56:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.617+0000 7f7c4effd640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 0x7f7c3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.617+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7c5008bc00 con 0x7f7c5815eca0 2024-04-16T12:56:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.617+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 0x7f7c3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.617+0000 7f7c5e29c640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 0x7f7c3c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c54035000 tx=0x7f7c54030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.621+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c50092080 con 0x7f7c5815eca0 2024-04-16T12:56:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.808+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c58162030 con 0x7f7c5815eca0 2024-04-16T12:56:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.809+0000 7f7c4effd640 1 -- 172.21.15.18:0/2022150017 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f7c50017020 con 0x7f7c5815eca0 2024-04-16T12:56:07.811 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:07.811 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 msgr2=0x7f7c3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 0x7f7c3c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c54035000 tx=0x7f7c54030000 comp rx=0 tx=0).stop 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 msgr2=0x7f7c580cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000e7e0 tx=0x7f7c5000eca0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 shutdown_connections 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7c3c06c8f0 0x7f7c3c06edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5815eca0 0x7f7c580cdb70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c580d4370 0x7f7c581e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 --2- 172.21.15.18:0/2022150017 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7c580b37e0 0x7f7c5815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 >> 172.21.15.18:0/2022150017 conn(0x7f7c580d48b0 msgr2=0x7f7c580b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 shutdown_connections 2024-04-16T12:56:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.811+0000 7f7c60500640 1 -- 172.21.15.18:0/2022150017 wait complete. 2024-04-16T12:56:07.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T12:55:06.646321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T12:55:07.918882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T12:55:11.618318+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T12:56:07.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:56:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.930+0000 7f21d889a640 1 Processor -- start 2024-04-16T12:56:07.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.930+0000 7f21d889a640 1 -- start start 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.931+0000 7f21d889a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21d415ee20 0x7f21d40b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.931+0000 7f21d889a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.931+0000 7f21d889a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d406e4b0 con 0x7f21d40ce030 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.931+0000 7f21d889a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f21d40b0b40 con 0x7f21d415ee20 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.931+0000 7f21d889a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f21d40b0e20 con 0x7f21d4070300 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21d259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21d415ee20 0x7f21d40b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:49258/0 (socket says 172.21.15.18:49258) 2024-04-16T12:56:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 -- 172.21.15.18:0/3628011227 learned_addr learned my addr 172.21.15.18:0/3628011227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 -- 172.21.15.18:0/3628011227 >> v2:172.21.15.104:3300/0 conn(0x7f21d415ee20 msgr2=0x7f21d40b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 --2- 172.21.15.18:0/3628011227 >> v2:172.21.15.104:3300/0 conn(0x7f21d415ee20 0x7f21d40b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 -- 172.21.15.18:0/3628011227 >> v1:172.21.15.104:6789/0 conn(0x7f21d40ce030 legacy=0x7f21d40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.932+0000 7f21c9d9b640 1 -- 172.21.15.18:0/3628011227 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40cf5c0 con 0x7f21d4070300 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21c9d9b640 1 --2- 172.21.15.18:0/3628011227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2349f8290d5f5e59 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d1d9b640 1 -- 172.21.15.18:0/3628011227 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc034070 con 0x7f21d4070300 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d1d9b640 1 -- 172.21.15.18:0/3628011227 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc030840 con 0x7f21d4070300 2024-04-16T12:56:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d1d9b640 1 -- 172.21.15.18:0/3628011227 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc030c10 con 0x7f21d4070300 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 -- 172.21.15.18:0/3628011227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 msgr2=0x7f21d4070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 --2- 172.21.15.18:0/3628011227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02b980 comp rx=0 tx=0).stop 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 -- 172.21.15.18:0/3628011227 shutdown_connections 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 --2- 172.21.15.18:0/3628011227 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d4070300 0x7f21d4070760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 --2- 172.21.15.18:0/3628011227 >> v2:172.21.15.104:3300/0 conn(0x7f21d415ee20 0x7f21d40b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 -- 172.21.15.18:0/3628011227 >> 172.21.15.18:0/3628011227 conn(0x7f21d409aa10 msgr2=0x7f21d40b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 -- 172.21.15.18:0/3628011227 shutdown_connections 2024-04-16T12:56:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.933+0000 7f21d889a640 1 -- 172.21.15.18:0/3628011227 wait complete. 2024-04-16T12:56:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.935+0000 7f21d889a640 1 Processor -- start 2024-04-16T12:56:07.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.935+0000 7f21d889a640 1 -- start start 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d40ce030 0x7f21d409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d415ee20 0x7f21d409e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21d40b0810 con 0x7f21d4070300 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f21d40cfb80 con 0x7f21d40ce030 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d889a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f21d4070ca0 con 0x7f21d415ee20 2024-04-16T12:56:07.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44246/0 (socket says 172.21.15.18:44246) 2024-04-16T12:56:07.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 -- 172.21.15.18:0/1177851002 learned_addr learned my addr 172.21.15.18:0/1177851002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21c9d9b640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d40ce030 0x7f21d409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d2d9d640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d415ee20 0x7f21d409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 -- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d415ee20 msgr2=0x7f21d409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d415ee20 0x7f21d409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 -- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d40ce030 msgr2=0x7f21d409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d40ce030 0x7f21d409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 -- 172.21.15.18:0/1177851002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40d0db0 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21d259c640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.936+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4017070 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.937+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c400c940 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.937+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d40d1090 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.937+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400cd30 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.937+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d40d1650 con 0x7f21d4070300 2024-04-16T12:56:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.938+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d4068a70 con 0x7f21d4070300 2024-04-16T12:56:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.938+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21c401a070 con 0x7f21d4070300 2024-04-16T12:56:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.938+0000 7f21cb7fe640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 0x7f21b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.939+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f21c408c0f0 con 0x7f21d4070300 2024-04-16T12:56:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.939+0000 7f21c9d9b640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 0x7f21b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.939+0000 7f21c9d9b640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 0x7f21b406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f21bc036000 tx=0x7f21bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:07.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:07.943+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21c4059ad0 con 0x7f21d4070300 2024-04-16T12:56:08.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.129+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21d40d19c0 con 0x7f21d4070300 2024-04-16T12:56:08.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.130+0000 7f21cb7fe640 1 -- 172.21.15.18:0/1177851002 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f21c405ddd0 con 0x7f21d4070300 2024-04-16T12:56:08.131 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 msgr2=0x7f21b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 0x7f21b406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f21bc036000 tx=0x7f21bc008030 comp rx=0 tx=0).stop 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 msgr2=0x7f21d40cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400ed30 comp rx=0 tx=0).stop 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 shutdown_connections 2024-04-16T12:56:08.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f21b406c8f0 0x7f21b406edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f21d415ee20 0x7f21d409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d40ce030 0x7f21d409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 --2- 172.21.15.18:0/1177851002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21d4070300 0x7f21d40cd820 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 >> 172.21.15.18:0/1177851002 conn(0x7f21d409aa10 msgr2=0x7f21d40b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 shutdown_connections 2024-04-16T12:56:08.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.132+0000 7f21d889a640 1 -- 172.21.15.18:0/1177851002 wait complete. 2024-04-16T12:56:08.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T12:56:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.251+0000 7ff238752640 1 Processor -- start 2024-04-16T12:56:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.251+0000 7ff238752640 1 -- start start 2024-04-16T12:56:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff238752640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2300b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff238752640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff23006ba20 0x7ff23006bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff238752640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23006c6c0 con 0x7ff230162240 2024-04-16T12:56:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff238752640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff23006c9a0 con 0x7ff23006ba20 2024-04-16T12:56:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff238752640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300d2db0 con 0x7ff23006d520 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff2364ee640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff230162240 0x7ff23006ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43584/0 (socket says 172.21.15.18:43584) 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff2364ee640 1 -- 172.21.15.18:0/504948461 learned_addr learned my addr 172.21.15.18:0/504948461 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78593712 0 0) 0x7ff23006c6c0 con 0x7ff230162240 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff218003520 con 0x7ff230162240 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff235ced640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2300b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.252+0000 7ff236cef640 1 --2- 172.21.15.18:0/504948461 >> v2:172.21.15.104:3300/0 conn(0x7ff23006ba20 0x7ff23006bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 759260179 0 0) 0x7ff218003520 con 0x7ff230162240 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 msgr2=0x7ff2300b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2300b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 >> v2:172.21.15.104:3300/0 conn(0x7ff23006ba20 msgr2=0x7ff23006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 --2- 172.21.15.18:0/504948461 >> v2:172.21.15.104:3300/0 conn(0x7ff23006ba20 0x7ff23006bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2300d3090 con 0x7ff230162240 2024-04-16T12:56:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7ff220001670 con 0x7ff230162240 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 >> v1:172.21.15.18:6789/0 conn(0x7ff230162240 legacy=0x7ff23006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2180039b0 0x7ff218003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff218004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff23006c9a0 con 0x7ff218004800 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300d2db0 con 0x7ff2180039b0 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff21800b9c0 con 0x7ff23006d520 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff218004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff236cef640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2364ee640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2180039b0 0x7ff218003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 -- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 msgr2=0x7ff2180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 -- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2180039b0 msgr2=0x7ff218003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2180039b0 0x7ff218003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff235ced640 1 -- 172.21.15.18:0/504948461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff218003520 con 0x7ff218004800 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff236cef640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff23006d520 0x7ff2180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.253+0000 7ff2364ee640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2180039b0 0x7ff218003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff235ced640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff218004c80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff224009ac0 tx=0x7ff218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f12f2b48daddd62 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224039070 con 0x7ff218004800 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22402c680 con 0x7ff218004800 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff2354ec640 1 -- 172.21.15.18:0/504948461 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224009690 con 0x7ff218004800 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff238752640 1 -- 172.21.15.18:0/504948461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 msgr2=0x7ff218004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff238752640 1 --2- 172.21.15.18:0/504948461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff218004c80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff224009ac0 tx=0x7ff218005830 comp rx=0 tx=0).stop 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.254+0000 7ff236cef640 1 -- 172.21.15.18:0/504948461 reap_dead start 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.255+0000 7ff238752640 1 -- 172.21.15.18:0/504948461 shutdown_connections 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.255+0000 7ff238752640 1 -- 172.21.15.18:0/504948461 >> 172.21.15.18:0/504948461 conn(0x7ff2300d48b0 msgr2=0x7ff2300d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.255+0000 7ff238752640 1 -- 172.21.15.18:0/504948461 shutdown_connections 2024-04-16T12:56:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.255+0000 7ff238752640 1 -- 172.21.15.18:0/504948461 wait complete. 2024-04-16T12:56:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.256+0000 7ff238752640 1 Processor -- start 2024-04-16T12:56:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.256+0000 7ff238752640 1 -- start start 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.256+0000 7ff238752640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 0x7ff23015e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 0x7ff2300cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300b7c80 con 0x7ff218004800 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff2300b7b00 con 0x7ff23015e500 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300b7e00 con 0x7ff2300cbd00 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44268/0 (socket says 172.21.15.18:44268) 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 -- 172.21.15.18:0/3887344522 learned_addr learned my addr 172.21.15.18:0/3887344522 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff236cef640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 0x7ff2300cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff235ced640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 0x7ff23015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 -- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 msgr2=0x7ff2300cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 0x7ff2300cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 -- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 msgr2=0x7ff23015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 0x7ff23015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 -- 172.21.15.18:0/3887344522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23015eec0 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff236cef640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 0x7ff2300cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff235ced640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 0x7ff23015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff2364ee640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e7b0 tx=0x7ff22000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22000c8d0 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff220018070 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2300cd5e0 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22000cc90 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.257+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2300ccd40 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.258+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2300752b0 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.259+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff220013420 con 0x7ff218004800 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.259+0000 7ff22effd640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.260+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff22008bb30 con 0x7ff218004800 2024-04-16T12:56:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.260+0000 7ff235ced640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.260+0000 7ff235ced640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 0x7ff21c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff224036000 tx=0x7ff224030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.264+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff220059bf0 con 0x7ff218004800 2024-04-16T12:56:08.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.447+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff230147990 con 0x7ff218004800 2024-04-16T12:56:08.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.447+0000 7ff22effd640 1 -- 172.21.15.18:0/3887344522 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff2200594f0 con 0x7ff218004800 2024-04-16T12:56:08.449 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 msgr2=0x7ff21c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 0x7ff21c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff224036000 tx=0x7ff224030000 comp rx=0 tx=0).stop 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 msgr2=0x7ff2301f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e7b0 tx=0x7ff22000ec70 comp rx=0 tx=0).stop 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 shutdown_connections 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff2300cbd00 0x7ff2300cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff23015e500 0x7ff23015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 --2- 172.21.15.18:0/3887344522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff218004800 0x7ff2301f3d90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 >> 172.21.15.18:0/3887344522 conn(0x7ff2300d48b0 msgr2=0x7ff2300ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 shutdown_connections 2024-04-16T12:56:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.449+0000 7ff238752640 1 -- 172.21.15.18:0/3887344522 wait complete. 2024-04-16T12:56:08.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T12:56:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.571+0000 7f72e3a93640 1 Processor -- start 2024-04-16T12:56:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 -- start start 2024-04-16T12:56:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f72dc06e270 0x7f72dc06f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc06e6a0 con 0x7f72dc15ee90 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0d0be0 con 0x7f72dc06e270 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.572+0000 7f72e3a93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0d0ec0 con 0x7f72dc0b0c50 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e102e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e2030640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f72dc06e270 0x7f72dc06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e102e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:49300/0 (socket says 172.21.15.18:49300) 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e102e640 1 -- 172.21.15.18:0/4229220225 learned_addr learned my addr 172.21.15.18:0/4229220225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e2030640 1 -- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 msgr2=0x7f72dc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e2030640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e2030640 1 -- 172.21.15.18:0/4229220225 >> v1:172.21.15.104:6789/0 conn(0x7f72dc15ee90 legacy=0x7f72dc06d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e2030640 1 -- 172.21.15.18:0/4229220225 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0d11a0 con 0x7f72dc06e270 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e082d640 1 -- 172.21.15.18:0/4229220225 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998678519 0 0) 0x7f72dc06e6a0 con 0x7f72dc15ee90 2024-04-16T12:56:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.573+0000 7f72e102e640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.574+0000 7f72e2030640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc06f100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009d90 tx=0x7f72cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66116192e5f5dcc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.574+0000 7f72e082d640 1 -- 172.21.15.18:0/4229220225 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc039070 con 0x7f72dc06e270 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.574+0000 7f72e082d640 1 -- 172.21.15.18:0/4229220225 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc02cc50 con 0x7f72dc06e270 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.574+0000 7f72e082d640 1 -- 172.21.15.18:0/4229220225 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc034440 con 0x7f72dc06e270 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 -- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 msgr2=0x7f72dc06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc06f100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009d90 tx=0x7f72cc02bea0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 -- 172.21.15.18:0/4229220225 shutdown_connections 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc06f100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 --2- 172.21.15.18:0/4229220225 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 -- 172.21.15.18:0/4229220225 >> 172.21.15.18:0/4229220225 conn(0x7f72dc09aa10 msgr2=0x7f72dc0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 -- 172.21.15.18:0/4229220225 shutdown_connections 2024-04-16T12:56:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.575+0000 7f72e3a93640 1 -- 172.21.15.18:0/4229220225 wait complete. 2024-04-16T12:56:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.576+0000 7f72e3a93640 1 Processor -- start 2024-04-16T12:56:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.576+0000 7f72e3a93640 1 -- start start 2024-04-16T12:56:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc14b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15f270 con 0x7f72dc15ee90 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0b3d70 con 0x7f72dc06e270 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc15f3f0 con 0x7f72dc0b0c50 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44274/0 (socket says 172.21.15.18:44274) 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 -- 172.21.15.18:0/3650793812 learned_addr learned my addr 172.21.15.18:0/3650793812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e182f640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e102e640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 -- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 msgr2=0x7f72dc14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 -- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 msgr2=0x7f72dc0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 -- 172.21.15.18:0/3650793812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc14c0d0 con 0x7f72dc15ee90 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e2030640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72cc037040 tx=0x7f72cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc044020 con 0x7f72dc15ee90 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc03a040 con 0x7f72dc15ee90 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.577+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0ae450 con 0x7f72dc15ee90 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.578+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc039050 con 0x7f72dc15ee90 2024-04-16T12:56:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.578+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc0aea10 con 0x7f72dc15ee90 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.579+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0af4b0 con 0x7f72dc15ee90 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.579+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72cc003990 con 0x7f72dc15ee90 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.579+0000 7f72da7fc640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 0x7f72c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.579+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f72cc0ae200 con 0x7f72dc15ee90 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.579+0000 7f72e182f640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 0x7f72c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.580+0000 7f72e182f640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 0x7f72c806edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000f60 tx=0x7f72d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.584+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f72dc0af4b0 con 0x7f72dc15ee90 2024-04-16T12:56:08.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.768+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f72dc068a70 con 0x7f72dc15ee90 2024-04-16T12:56:08.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.768+0000 7f72da7fc640 1 -- 172.21.15.18:0/3650793812 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f72cc04e060 con 0x7f72dc15ee90 2024-04-16T12:56:08.770 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 msgr2=0x7f72c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 0x7f72c806edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000f60 tx=0x7f72d4009040 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 msgr2=0x7f72dc14bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72cc037040 tx=0x7f72cc004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 shutdown_connections 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72c806c8f0 0x7f72c806edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72dc15ee90 0x7f72dc14bb90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72dc0b0c50 0x7f72dc14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 --2- 172.21.15.18:0/3650793812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc06e270 0x7f72dc0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 >> 172.21.15.18:0/3650793812 conn(0x7f72dc09aa10 msgr2=0x7f72dc0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 shutdown_connections 2024-04-16T12:56:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.770+0000 7f72e3a93640 1 -- 172.21.15.18:0/3650793812 wait complete. 2024-04-16T12:56:08.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T12:56:08.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.890+0000 7f11b5a14640 1 Processor -- start 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.890+0000 7f11b5a14640 1 -- start start 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11b5a14640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f11b0162240 0x7f11b00b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11b5a14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11b006c130 0x7f11b006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11b5a14640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b006c6c0 con 0x7f11b006ce10 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11b5a14640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f11b006d7b0 con 0x7f11b006c130 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11b5a14640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f11b006c9a0 con 0x7f11b0162240 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11b006c130 0x7f11b006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11b006c130 0x7f11b006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44284/0 (socket says 172.21.15.18:44284) 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 -- 172.21.15.18:0/3080123960 learned_addr learned my addr 172.21.15.18:0/3080123960 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11aeffd640 1 --2- 172.21.15.18:0/3080123960 >> v2:172.21.15.104:3300/0 conn(0x7f11b0162240 0x7f11b00b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 -- 172.21.15.18:0/3080123960 >> v2:172.21.15.104:3300/0 conn(0x7f11b0162240 msgr2=0x7f11b00b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 --2- 172.21.15.18:0/3080123960 >> v2:172.21.15.104:3300/0 conn(0x7f11b0162240 0x7f11b00b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 -- 172.21.15.18:0/3080123960 >> v1:172.21.15.104:6789/0 conn(0x7f11b006ce10 legacy=0x7f11b006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.891+0000 7f11af7fe640 1 -- 172.21.15.18:0/3080123960 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b00d2db0 con 0x7f11b006c130 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.892+0000 7f11af7fe640 1 --2- 172.21.15.18:0/3080123960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b006c130 0x7f11b006d270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009e50 tx=0x7f11a802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32953142f78a8de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.892+0000 7f11ae7fc640 1 -- 172.21.15.18:0/3080123960 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a802c9f0 con 0x7f11b006c130 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.892+0000 7f11ae7fc640 1 -- 172.21.15.18:0/3080123960 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a802cb90 con 0x7f11b006c130 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.892+0000 7f11ae7fc640 1 -- 172.21.15.18:0/3080123960 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80343f0 con 0x7f11b006c130 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 -- 172.21.15.18:0/3080123960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b006c130 msgr2=0x7f11b006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 --2- 172.21.15.18:0/3080123960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b006c130 0x7f11b006d270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009e50 tx=0x7f11a802be50 comp rx=0 tx=0).stop 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 -- 172.21.15.18:0/3080123960 shutdown_connections 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 --2- 172.21.15.18:0/3080123960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b006c130 0x7f11b006d270 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 --2- 172.21.15.18:0/3080123960 >> v2:172.21.15.104:3300/0 conn(0x7f11b0162240 0x7f11b00b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 -- 172.21.15.18:0/3080123960 >> 172.21.15.18:0/3080123960 conn(0x7f11b00d48b0 msgr2=0x7f11b00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 -- 172.21.15.18:0/3080123960 shutdown_connections 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.893+0000 7f11b5a14640 1 -- 172.21.15.18:0/3080123960 wait complete. 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.894+0000 7f11b5a14640 1 Processor -- start 2024-04-16T12:56:08.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.894+0000 7f11b5a14640 1 -- start start 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b006c130 0x7f11b0159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11b006ce10 0x7f11b015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00d3a10 con 0x7f11b0162240 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00d3890 con 0x7f11b006c130 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f11b00d3b90 con 0x7f11b006ce10 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44294/0 (socket says 172.21.15.18:44294) 2024-04-16T12:56:08.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 -- 172.21.15.18:0/4095690222 learned_addr learned my addr 172.21.15.18:0/4095690222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:08.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11aeffd640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b006c130 0x7f11b0159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11a7fff640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11b006ce10 0x7f11b015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 -- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11b006ce10 msgr2=0x7f11b015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11b006ce10 0x7f11b015cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 -- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b006c130 msgr2=0x7f11b0159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:08.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b006c130 0x7f11b0159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:08.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 -- 172.21.15.18:0/4095690222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b015bbe0 con 0x7f11b0162240 2024-04-16T12:56:08.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11af7fe640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11a8036040 tx=0x7f11a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8043020 con 0x7f11b0162240 2024-04-16T12:56:08.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a803e450 con 0x7f11b0162240 2024-04-16T12:56:08.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b015bec0 con 0x7f11b0162240 2024-04-16T12:56:08.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.895+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8009510 con 0x7f11b0162240 2024-04-16T12:56:08.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.896+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b015c760 con 0x7f11b0162240 2024-04-16T12:56:08.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.897+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b015c090 con 0x7f11b0162240 2024-04-16T12:56:08.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.897+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11a8046020 con 0x7f11b0162240 2024-04-16T12:56:08.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.898+0000 7f11acff9640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 0x7f119006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:08.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.898+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f11a80ae6c0 con 0x7f11b0162240 2024-04-16T12:56:08.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.898+0000 7f11aeffd640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 0x7f119006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:08.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.899+0000 7f11aeffd640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 0x7f119006edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11a0006fd0 tx=0x7f11a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:08.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:08.902+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11a804d030 con 0x7f11b0162240 2024-04-16T12:56:09.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.086+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f11b015c960 con 0x7f11b0162240 2024-04-16T12:56:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.086+0000 7f11acff9640 1 -- 172.21.15.18:0/4095690222 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f11b015c960 con 0x7f11b0162240 2024-04-16T12:56:09.088 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 msgr2=0x7f119006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 0x7f119006edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11a0006fd0 tx=0x7f11a0008040 comp rx=0 tx=0).stop 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 msgr2=0x7f11b00ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11a8036040 tx=0x7f11a8004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 shutdown_connections 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f119006c8f0 0x7f119006edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11b0162240 0x7f11b00ccc70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f11b006ce10 0x7f11b015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 --2- 172.21.15.18:0/4095690222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b006c130 0x7f11b0159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 >> 172.21.15.18:0/4095690222 conn(0x7f11b00d48b0 msgr2=0x7f11b00b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 shutdown_connections 2024-04-16T12:56:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.088+0000 7f11b5a14640 1 -- 172.21.15.18:0/4095690222 wait complete. 2024-04-16T12:56:09.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:09.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.204+0000 7fc9c57c8640 1 Processor -- start 2024-04-16T12:56:09.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.204+0000 7fc9c57c8640 1 -- start start 2024-04-16T12:56:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.204+0000 7fc9c57c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c015eca0 0x7fc9c006c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.204+0000 7fc9c57c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9c00b37e0 0x7fc9c00d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.204+0000 7fc9c57c8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c00d4370 0x7fc9c006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9c57c8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c015f080 con 0x7fc9c00d4370 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9c57c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c00d2d90 con 0x7fc9c00b37e0 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9c57c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00d3070 con 0x7fc9c015eca0 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c00d4370 0x7fc9c006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c00d4370 0x7fc9c006ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44302/0 (socket says 172.21.15.18:44302) 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/687333089 learned_addr learned my addr 172.21.15.18:0/687333089 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/687333089 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c015eca0 msgr2=0x7fc9c006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/687333089 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c015eca0 0x7fc9c006c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/687333089 >> v2:172.21.15.104:3300/0 conn(0x7fc9c00b37e0 msgr2=0x7fc9c00d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/687333089 >> v2:172.21.15.104:3300/0 conn(0x7fc9c00b37e0 0x7fc9c00d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.205+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/687333089 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00d3350 con 0x7fc9c00d4370 2024-04-16T12:56:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/687333089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c00d4370 0x7fc9c006ce10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008d110 tx=0x7fc9b802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da13b2211e0b01 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9be7fc640 1 -- 172.21.15.18:0/687333089 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b802cb00 con 0x7fc9c00d4370 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9be7fc640 1 -- 172.21.15.18:0/687333089 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b802cca0 con 0x7fc9c00d4370 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9be7fc640 1 -- 172.21.15.18:0/687333089 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8034610 con 0x7fc9c00d4370 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 -- 172.21.15.18:0/687333089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c00d4370 msgr2=0x7fc9c006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/687333089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c00d4370 0x7fc9c006ce10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008d110 tx=0x7fc9b802bf60 comp rx=0 tx=0).stop 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 -- 172.21.15.18:0/687333089 shutdown_connections 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/687333089 >> v2:172.21.15.104:3300/0 conn(0x7fc9c00b37e0 0x7fc9c00d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/687333089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c00d4370 0x7fc9c006ce10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/687333089 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c015eca0 0x7fc9c006c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.206+0000 7fc9c57c8640 1 -- 172.21.15.18:0/687333089 >> 172.21.15.18:0/687333089 conn(0x7fc9c00d48b0 msgr2=0x7fc9c00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.207+0000 7fc9c57c8640 1 -- 172.21.15.18:0/687333089 shutdown_connections 2024-04-16T12:56:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.207+0000 7fc9c57c8640 1 -- 172.21.15.18:0/687333089 wait complete. 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 Processor -- start 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 -- start start 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 0x7fc9c0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c00d4370 0x7fc9c0159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c006c970 con 0x7fc9c015eca0 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00d3910 con 0x7fc9c00b37e0 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.208+0000 7fc9c57c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c006d350 con 0x7fc9c00d4370 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44314/0 (socket says 172.21.15.18:44314) 2024-04-16T12:56:09.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/1743540291 learned_addr learned my addr 172.21.15.18:0/1743540291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9b7fff640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c00d4370 0x7fc9c0159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9beffd640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 0x7fc9c0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c00d4370 msgr2=0x7fc9c0159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c00d4370 0x7fc9c0159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 msgr2=0x7fc9c0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 0x7fc9c0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 -- 172.21.15.18:0/1743540291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00cdc50 con 0x7fc9c015eca0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9beffd640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 0x7fc9c0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9bf7fe640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009f40 tx=0x7fc9b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8043020 con 0x7fc9c015eca0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b802ce50 con 0x7fc9c015eca0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c0152260 con 0x7fc9c015eca0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8009510 con 0x7fc9c015eca0 2024-04-16T12:56:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.209+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c00ce1a0 con 0x7fc9c015eca0 2024-04-16T12:56:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.210+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c00752b0 con 0x7fc9c015eca0 2024-04-16T12:56:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.211+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9b8046020 con 0x7fc9c015eca0 2024-04-16T12:56:09.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.211+0000 7fc9b77fe640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 0x7fc9a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.211+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc9b80ae620 con 0x7fc9c015eca0 2024-04-16T12:56:09.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.212+0000 7fc9beffd640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 0x7fc9a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.212+0000 7fc9beffd640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 0x7fc9a006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009890 tx=0x7fc9b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.216+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9b804d030 con 0x7fc9c015eca0 2024-04-16T12:56:09.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.442+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9c00b7ca0 con 0x7fc9c015eca0 2024-04-16T12:56:09.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.442+0000 7fc9b77fe640 1 -- 172.21.15.18:0/1743540291 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7fc9c0152260 con 0x7fc9c015eca0 2024-04-16T12:56:09.444 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:09.444 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:56:09.444 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 msgr2=0x7fc9a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 0x7fc9a006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009890 tx=0x7fc9b0008040 comp rx=0 tx=0).stop 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 msgr2=0x7fc9c00b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009f40 tx=0x7fc9b8004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 shutdown_connections 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc9a006c8f0 0x7fc9a006edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c015eca0 0x7fc9c00b5400 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc9c00d4370 0x7fc9c0159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 --2- 172.21.15.18:0/1743540291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c00b37e0 0x7fc9c0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 >> 172.21.15.18:0/1743540291 conn(0x7fc9c00d48b0 msgr2=0x7fc9c00d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 shutdown_connections 2024-04-16T12:56:09.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.444+0000 7fc9c57c8640 1 -- 172.21.15.18:0/1743540291 wait complete. 2024-04-16T12:56:09.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:09.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.560+0000 7f3405b96640 1 Processor -- start 2024-04-16T12:56:09.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.560+0000 7f3405b96640 1 -- start start 2024-04-16T12:56:09.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f3405b96640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f340015c820 0x7f34001603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f3405b96640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340015cc00 con 0x7f34000b48c0 2024-04-16T12:56:09.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f3405b96640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3400160a30 con 0x7f34000ccd80 2024-04-16T12:56:09.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f3405b96640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3400160d10 con 0x7f340015c820 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f33fffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f34000b48c0 0x7f34000d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43588/0 (socket says 172.21.15.18:43588) 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.561+0000 7f33fffff640 1 -- 172.21.15.18:0/2055291731 learned_addr learned my addr 172.21.15.18:0/2055291731 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/2055291731 >> v2:172.21.15.104:3300/0 conn(0x7f340015c820 0x7f34001603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903434530 0 0) 0x7f340015cc00 con 0x7f34000b48c0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e8003520 con 0x7f34000b48c0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3818249088 0 0) 0x7f33e8003520 con 0x7f34000b48c0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 >> v2:172.21.15.104:3300/0 conn(0x7f340015c820 msgr2=0x7f34001603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 --2- 172.21.15.18:0/2055291731 >> v2:172.21.15.104:3300/0 conn(0x7f340015c820 0x7f34001603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 >> v1:172.21.15.104:6789/0 conn(0x7f34000ccd80 legacy=0x7f34000b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3400160ff0 con 0x7f34000b48c0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f33f80019f0 con 0x7f34000b48c0 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 >> v1:172.21.15.18:6789/0 conn(0x7f34000b48c0 legacy=0x7f34000d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f33e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33e8004800 0x7f33e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33e80052e0 0x7f33e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3400160d10 con 0x7f33e80039b0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f33e800c1b0 con 0x7f33e80052e0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f33e800c3b0 con 0x7f33e8004800 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f33e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33feffd640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33e8004800 0x7f33e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fffff640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33e80052e0 0x7f33e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 -- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33e8004800 msgr2=0x7f33e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33e8004800 0x7f33e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 -- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33e80052e0 msgr2=0x7f33e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33e80052e0 0x7f33e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33ff7fe640 1 -- 172.21.15.18:0/2055291731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e8003520 con 0x7f33e80039b0 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33fffff640 1 -- 172.21.15.18:0/2055291731 reap_dead start 2024-04-16T12:56:09.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.562+0000 7f33feffd640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f33e8004800 0x7f33e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.563+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f33e8003dd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009a90 tx=0x7f33e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eba53ecbae0de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.563+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0039070 con 0x7f33e80039b0 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.563+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f002c680 con 0x7f33e80039b0 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.563+0000 7f33fe7fc640 1 -- 172.21.15.18:0/2055291731 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0009690 con 0x7f33e80039b0 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 -- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 msgr2=0x7f33e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f33e8003dd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009a90 tx=0x7f33e8005830 comp rx=0 tx=0).stop 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 -- 172.21.15.18:0/2055291731 shutdown_connections 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 --2- 172.21.15.18:0/2055291731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f33e8003dd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 -- 172.21.15.18:0/2055291731 >> 172.21.15.18:0/2055291731 conn(0x7f34000cf1b0 msgr2=0x7f34000cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 -- 172.21.15.18:0/2055291731 shutdown_connections 2024-04-16T12:56:09.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.564+0000 7f3405b96640 1 -- 172.21.15.18:0/2055291731 wait complete. 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.565+0000 7f3405b96640 1 Processor -- start 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.565+0000 7f3405b96640 1 -- start start 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 0x7f34000c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 0x7f340015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34001603c0 con 0x7f33e80039b0 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34000b8260 con 0x7f34000cab40 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f3405b96640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3400160540 con 0x7f340015cea0 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44332/0 (socket says 172.21.15.18:44332) 2024-04-16T12:56:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 -- 172.21.15.18:0/61349431 learned_addr learned my addr 172.21.15.18:0/61349431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33fffff640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 0x7f340015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33feffd640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 0x7f34000c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 -- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 msgr2=0x7f340015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 0x7f340015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 -- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 msgr2=0x7f34000c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 0x7f34000c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 -- 172.21.15.18:0/61349431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000cb0b0 con 0x7f33e80039b0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33fffff640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 0x7f340015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33feffd640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 0x7f34000c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.566+0000 7f33ff7fe640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f33f0037040 tx=0x7f33f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.567+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0039050 con 0x7f33e80039b0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.567+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f0045070 con 0x7f33e80039b0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.567+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00044e0 con 0x7f33e80039b0 2024-04-16T12:56:09.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.567+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34000cb390 con 0x7f33e80039b0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.567+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34000c8570 con 0x7f33e80039b0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.568+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3400068a70 con 0x7f33e80039b0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.568+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33f0003850 con 0x7f33e80039b0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.569+0000 7f33e7fff640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 0x7f33ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.569+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f33f00ad9b0 con 0x7f33e80039b0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.569+0000 7f33feffd640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 0x7f33ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.569+0000 7f33feffd640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 0x7f33ec06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33f4000c00 tx=0x7f33f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.573+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33f004e020 con 0x7f33e80039b0 2024-04-16T12:56:09.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.763+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34000cff70 con 0x7f33e80039b0 2024-04-16T12:56:09.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.764+0000 7f33e7fff640 1 -- 172.21.15.18:0/61349431 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7f33f007ba50 con 0x7f33e80039b0 2024-04-16T12:56:09.766 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:09.766 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 msgr2=0x7f33ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 0x7f33ec06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33f4000c00 tx=0x7f33f4009040 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 msgr2=0x7f3400150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f33f0037040 tx=0x7f33f0004730 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 shutdown_connections 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f33ec06c920 0x7f33ec06ede0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33f4000c00 tx=0x7f33f4009040 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f340015cea0 0x7f340015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34000cab40 0x7f34000c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 --2- 172.21.15.18:0/61349431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e80039b0 0x7f3400150530 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 >> 172.21.15.18:0/61349431 conn(0x7f34000cf1b0 msgr2=0x7f34000d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 shutdown_connections 2024-04-16T12:56:09.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.766+0000 7f3405b96640 1 -- 172.21.15.18:0/61349431 wait complete. 2024-04-16T12:56:09.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T12:56:09.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.882+0000 7f7ee65db640 1 Processor -- start 2024-04-16T12:56:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.882+0000 7f7ee65db640 1 -- start start 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee65db640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 0x7f7ee009b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee65db640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee0070e10 con 0x7f7ee009aa10 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee65db640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee00d21a0 con 0x7f7ee0071400 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee65db640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee00d2480 con 0x7f7ee00d1740 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee4b78640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7ee009aa10 0x7f7ee006d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43602/0 (socket says 172.21.15.18:43602) 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7ee4b78640 1 -- 172.21.15.18:0/3794654513 learned_addr learned my addr 172.21.15.18:0/3794654513 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edffff640 1 --2- 172.21.15.18:0/3794654513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 0x7f7ee009b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133847935 0 0) 0x7f7ee0070e10 con 0x7f7ee009aa10 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ec8003520 con 0x7f7ee009aa10 2024-04-16T12:56:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edffff640 1 -- 172.21.15.18:0/3794654513 >> v1:172.21.15.104:6789/0 conn(0x7f7ee0071400 legacy=0x7f7ee00d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784126239 0 0) 0x7f7ee00d21a0 con 0x7f7ee0071400 2024-04-16T12:56:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edffff640 1 -- 172.21.15.18:0/3794654513 >> v1:172.21.15.18:6789/0 conn(0x7f7ee009aa10 legacy=0x7f7ee006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.883+0000 7f7edffff640 1 -- 172.21.15.18:0/3794654513 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee00710b0 con 0x7f7ee00d1740 2024-04-16T12:56:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.884+0000 7f7edffff640 1 --2- 172.21.15.18:0/3794654513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 0x7f7ee009b750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097d0 tx=0x7f7ed002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9873e9bd621ff133 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.884+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0037070 con 0x7f7ee00d1740 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.884+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed0030510 con 0x7f7ee00d1740 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.884+0000 7f7edeffd640 1 -- 172.21.15.18:0/3794654513 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80019f0 con 0x7f7ee00d1740 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 -- 172.21.15.18:0/3794654513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 msgr2=0x7f7ee009b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3794654513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 0x7f7ee009b750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097d0 tx=0x7f7ed002b730 comp rx=0 tx=0).stop 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 -- 172.21.15.18:0/3794654513 shutdown_connections 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3794654513 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee00d1740 0x7f7ee009b750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 -- 172.21.15.18:0/3794654513 >> 172.21.15.18:0/3794654513 conn(0x7f7ee00d2600 msgr2=0x7f7ee00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 -- 172.21.15.18:0/3794654513 shutdown_connections 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.885+0000 7f7ee65db640 1 -- 172.21.15.18:0/3794654513 wait complete. 2024-04-16T12:56:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.886+0000 7f7ee65db640 1 Processor -- start 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.886+0000 7f7ee65db640 1 -- start start 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 0x7f7ee009e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee00d1740 0x7f7ee0151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00d1b20 con 0x7f7ee0071400 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00720c0 con 0x7f7ee00d1740 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7ee65db640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee009aea0 con 0x7f7ee009aa10 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7edffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7edffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44348/0 (socket says 172.21.15.18:44348) 2024-04-16T12:56:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7edffff640 1 -- 172.21.15.18:0/3577959798 learned_addr learned my addr 172.21.15.18:0/3577959798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7edffff640 1 -- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 msgr2=0x7f7ee009e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.887+0000 7f7edf7fe640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 0x7f7ee009e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edffff640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 0x7f7ee009e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7ee4b78640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee00d1740 0x7f7ee0151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edffff640 1 -- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee00d1740 msgr2=0x7f7ee0151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edffff640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee00d1740 0x7f7ee0151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edffff640 1 -- 172.21.15.18:0/3577959798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee01525f0 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edf7fe640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 0x7f7ee009e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edffff640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0000c00 tx=0x7f7ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0042070 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed003e870 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0037040 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee0152890 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.888+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee0152e50 con 0x7f7ee0071400 2024-04-16T12:56:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.889+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee00752b0 con 0x7f7ee0071400 2024-04-16T12:56:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.889+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ed0045070 con 0x7f7ee0071400 2024-04-16T12:56:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.890+0000 7f7edcff9640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 0x7f7ecc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.890+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7ed00ad850 con 0x7f7ee0071400 2024-04-16T12:56:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.890+0000 7f7edf7fe640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 0x7f7ecc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.891+0000 7f7edf7fe640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 0x7f7ecc06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00d30f0 tx=0x7f7ed4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:09.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:09.894+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ed004c070 con 0x7f7ee0071400 2024-04-16T12:56:10.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.119+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ee0071ea0 con 0x7f7ee0071400 2024-04-16T12:56:10.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.120+0000 7f7edcff9640 1 -- 172.21.15.18:0/3577959798 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f7ed007b910 con 0x7f7ee0071400 2024-04-16T12:56:10.122 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:10.122 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 msgr2=0x7f7ecc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 0x7f7ecc06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00d30f0 tx=0x7f7ed4009040 comp rx=0 tx=0).stop 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 msgr2=0x7f7ee00c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0000c00 tx=0x7f7ed00046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 shutdown_connections 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7ecc06c920 0x7f7ecc06ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee00d1740 0x7f7ee0151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ee009aa10 0x7f7ee009e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 --2- 172.21.15.18:0/3577959798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee0071400 0x7f7ee00c8880 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 >> 172.21.15.18:0/3577959798 conn(0x7f7ee00d2600 msgr2=0x7f7ee00af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 shutdown_connections 2024-04-16T12:56:10.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.122+0000 7f7ee65db640 1 -- 172.21.15.18:0/3577959798 wait complete. 2024-04-16T12:56:10.137 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:10.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.246+0000 7f31f01e2640 1 Processor -- start 2024-04-16T12:56:10.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.246+0000 7f31f01e2640 1 -- start start 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31f01e2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e815e930 0x7f31e806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31f01e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31e806dc00 0x7f31e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31f01e2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e80af160 con 0x7f31e806bf60 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31f01e2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f31e806f550 con 0x7f31e806dc00 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31f01e2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31e80af400 con 0x7f31e815e930 2024-04-16T12:56:10.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31ee77f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31e806dc00 0x7f31e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31ed77d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f31e806bf60 0x7f31e80ae770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43614/0 (socket says 172.21.15.18:43614) 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31ed77d640 1 -- 172.21.15.18:0/562755990 learned_addr learned my addr 172.21.15.18:0/562755990 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.247+0000 7f31edf7e640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e815e930 0x7f31e806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ee77f640 1 -- 172.21.15.18:0/562755990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e815e930 msgr2=0x7f31e806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ee77f640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e815e930 0x7f31e806ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ee77f640 1 -- 172.21.15.18:0/562755990 >> v1:172.21.15.18:6789/0 conn(0x7f31e806bf60 legacy=0x7f31e80ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ee77f640 1 -- 172.21.15.18:0/562755990 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e806f770 con 0x7f31e806dc00 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ecf7c640 1 -- 172.21.15.18:0/562755990 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357770331 0 0) 0x7f31e80af160 con 0x7f31e806bf60 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ee77f640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e806dc00 0x7f31e806e090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009dc0 tx=0x7f31e002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6784cbd860b426dd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.248+0000 7f31ecf7c640 1 -- 172.21.15.18:0/562755990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0039070 con 0x7f31e806dc00 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31ecf7c640 1 -- 172.21.15.18:0/562755990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e002cc40 con 0x7f31e806dc00 2024-04-16T12:56:10.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31ecf7c640 1 -- 172.21.15.18:0/562755990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0034440 con 0x7f31e806dc00 2024-04-16T12:56:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 -- 172.21.15.18:0/562755990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e806dc00 msgr2=0x7f31e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e806dc00 0x7f31e806e090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009dc0 tx=0x7f31e002be90 comp rx=0 tx=0).stop 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 -- 172.21.15.18:0/562755990 shutdown_connections 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e806dc00 0x7f31e806e090 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 --2- 172.21.15.18:0/562755990 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e815e930 0x7f31e806ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 -- 172.21.15.18:0/562755990 >> 172.21.15.18:0/562755990 conn(0x7f31e80b6300 msgr2=0x7f31e809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 -- 172.21.15.18:0/562755990 shutdown_connections 2024-04-16T12:56:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.249+0000 7f31f01e2640 1 -- 172.21.15.18:0/562755990 wait complete. 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.250+0000 7f31f01e2640 1 Processor -- start 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.250+0000 7f31f01e2640 1 -- start start 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e806dc00 0x7f31e81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 0x7f31e8153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b0e20 con 0x7f31e8151a90 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80aee80 con 0x7f31e815e930 2024-04-16T12:56:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31f01e2640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31e80b0fa0 con 0x7f31e806dc00 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44364/0 (socket says 172.21.15.18:44364) 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 -- 172.21.15.18:0/2830954067 learned_addr learned my addr 172.21.15.18:0/2830954067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31edf7e640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e806dc00 0x7f31e81571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ed77d640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 0x7f31e8153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 -- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e806dc00 msgr2=0x7f31e81571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e806dc00 0x7f31e81571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 -- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 msgr2=0x7f31e8153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 0x7f31e8153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ee77f640 1 -- 172.21.15.18:0/2830954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e815ef60 con 0x7f31e8151a90 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.251+0000 7f31ed77d640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 0x7f31e8153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31ee77f640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f31e0037040 tx=0x7f31e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0039050 con 0x7f31e8151a90 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e0045070 con 0x7f31e8151a90 2024-04-16T12:56:10.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e815f240 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0040690 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.252+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e815f800 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.253+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e80752b0 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.253+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31e0040830 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.254+0000 7f31da7fc640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.254+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f31e00aea80 con 0x7f31e8151a90 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.254+0000 7f31edf7e640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.254+0000 7f31edf7e640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31dc006fd0 tx=0x7f31dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.258+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31e007cab0 con 0x7f31e8151a90 2024-04-16T12:56:10.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.482+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31e80b2770 con 0x7f31e8151a90 2024-04-16T12:56:10.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.482+0000 7f31da7fc640 1 -- 172.21.15.18:0/2830954067 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5189 (secure 0 0 0) 0x7f31e007c3b0 con 0x7f31e8151a90 2024-04-16T12:56:10.484 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:10.484 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1353496045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1353496045},{"type":"v1","addr":"172.21.15.18:6833","nonce":1353496045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/2304544560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2304544560},{"type":"v1","addr":"172.21.15.104:6836","nonce":2304544560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":54149,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1407345576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1407345576},{"type":"v1","addr":"172.21.15.18:6835","nonce":1407345576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:55:08.969245+0000","modified":"2024-04-16T12:55:31.032697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54158":{"gid":54158,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/2445582295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2445582295},{"type":"v1","addr":"172.21.15.104:6837","nonce":2445582295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54158,"qdb_cluster":[54158]},"id":1}]} 2024-04-16T12:56:10.484 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 msgr2=0x7f31cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31dc006fd0 tx=0x7f31dc008040 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 msgr2=0x7f31e8161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f31e0037040 tx=0x7f31e0004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 shutdown_connections 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31cc06c8f0 0x7f31cc06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31e8151a90 0x7f31e8161170 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31e815e930 0x7f31e8153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 --2- 172.21.15.18:0/2830954067 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31e806dc00 0x7f31e81571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 >> 172.21.15.18:0/2830954067 conn(0x7f31e80b6300 msgr2=0x7f31e80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 shutdown_connections 2024-04-16T12:56:10.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.484+0000 7f31f01e2640 1 -- 172.21.15.18:0/2830954067 wait complete. 2024-04-16T12:56:10.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:10.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.600+0000 7ff0eb3a1640 1 Processor -- start 2024-04-16T12:56:10.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.600+0000 7ff0eb3a1640 1 -- start start 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eb3a1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 0x7ff0e40d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eb3a1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e40b87b0 0x7ff0e40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eb3a1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e40d2a60 con 0x7ff0e40b6190 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eb3a1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e40b6b30 con 0x7ff0e40b87b0 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eb3a1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e415ede0 con 0x7ff0e415ea00 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e40b87b0 0x7ff0e40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e40b87b0 0x7ff0e40b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44380/0 (socket says 172.21.15.18:44380) 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 -- 172.21.15.18:0/269977543 learned_addr learned my addr 172.21.15.18:0/269977543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0e9b9e640 1 --1- 172.21.15.18:0/269977543 >> v1:172.21.15.18:6789/0 conn(0x7ff0e40b6190 0x7ff0e406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43618/0 (socket says 172.21.15.18:43618) 2024-04-16T12:56:10.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0ea39f640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 0x7ff0e40d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 -- 172.21.15.18:0/269977543 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 msgr2=0x7ff0e40d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 0x7ff0e40d3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 -- 172.21.15.18:0/269977543 >> v1:172.21.15.18:6789/0 conn(0x7ff0e40b6190 legacy=0x7ff0e406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0eaba0640 1 -- 172.21.15.18:0/269977543 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e40d2d40 con 0x7ff0e40b87b0 2024-04-16T12:56:10.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.601+0000 7ff0ea39f640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 0x7ff0e40d3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:10.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.602+0000 7ff0eaba0640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e40b87b0 0x7ff0e40b65f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009e50 tx=0x7ff0dc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89711d791cc9c880 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.602+0000 7ff0e939d640 1 -- 172.21.15.18:0/269977543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc02cb00 con 0x7ff0e40b87b0 2024-04-16T12:56:10.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.602+0000 7ff0e939d640 1 -- 172.21.15.18:0/269977543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc02cca0 con 0x7ff0e40b87b0 2024-04-16T12:56:10.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.602+0000 7ff0e939d640 1 -- 172.21.15.18:0/269977543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc034610 con 0x7ff0e40b87b0 2024-04-16T12:56:10.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/269977543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e40b87b0 msgr2=0x7ff0e40b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e40b87b0 0x7ff0e40b65f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009e50 tx=0x7ff0dc02bf60 comp rx=0 tx=0).stop 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/269977543 shutdown_connections 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e40b87b0 0x7ff0e40b65f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/269977543 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e415ea00 0x7ff0e40d3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/269977543 >> 172.21.15.18:0/269977543 conn(0x7ff0e40d1190 msgr2=0x7ff0e40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/269977543 shutdown_connections 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.603+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/269977543 wait complete. 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.604+0000 7ff0eb3a1640 1 Processor -- start 2024-04-16T12:56:10.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.604+0000 7ff0eb3a1640 1 -- start start 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0e40b6190 0x7ff0e4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e40b87b0 0x7ff0e40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40d35e0 con 0x7ff0e415ea00 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40d3300 con 0x7ff0e40b6190 2024-04-16T12:56:10.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eb3a1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e40b3b60 con 0x7ff0e40b87b0 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44396/0 (socket says 172.21.15.18:44396) 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 -- 172.21.15.18:0/3930553290 learned_addr learned my addr 172.21.15.18:0/3930553290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0ea39f640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0e40b6190 0x7ff0e4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0e9b9e640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e40b87b0 0x7ff0e40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 -- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e40b87b0 msgr2=0x7ff0e40cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e40b87b0 0x7ff0e40cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 -- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0e40b6190 msgr2=0x7ff0e4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0e40b6190 0x7ff0e4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 -- 172.21.15.18:0/3930553290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e4152fa0 con 0x7ff0e415ea00 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.605+0000 7ff0eaba0640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc036040 tx=0x7ff0dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.606+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc043020 con 0x7ff0e415ea00 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.606+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc02ce50 con 0x7ff0e415ea00 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.606+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e40cdc70 con 0x7ff0e415ea00 2024-04-16T12:56:10.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.606+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc009510 con 0x7ff0e415ea00 2024-04-16T12:56:10.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.606+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e40cceb0 con 0x7ff0e415ea00 2024-04-16T12:56:10.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.607+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e404fd90 con 0x7ff0e415ea00 2024-04-16T12:56:10.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.607+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0dc046020 con 0x7ff0e415ea00 2024-04-16T12:56:10.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.607+0000 7ff0daffd640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 0x7ff0c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.607+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff0dc0ae4d0 con 0x7ff0e415ea00 2024-04-16T12:56:10.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.608+0000 7ff0ea39f640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 0x7ff0c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.608+0000 7ff0ea39f640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 0x7ff0c806ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0006e80 tx=0x7ff0e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.612+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0dc04d030 con 0x7ff0e415ea00 2024-04-16T12:56:10.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.798+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0e40d3d20 con 0x7ff0e415ea00 2024-04-16T12:56:10.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.799+0000 7ff0daffd640 1 -- 172.21.15.18:0/3930553290 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7ff0dc07be10 con 0x7ff0e415ea00 2024-04-16T12:56:10.800 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:10.800 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:55:49.965537+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:55:06.646321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T12:55:07.918882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T12:55:11.618318+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:10.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 msgr2=0x7ff0c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 0x7ff0c806ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0006e80 tx=0x7ff0e0008040 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 msgr2=0x7ff0e41f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc036040 tx=0x7ff0dc004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 shutdown_connections 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff0c806c920 0x7ff0c806ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e415ea00 0x7ff0e41f4640 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff0e40b87b0 0x7ff0e40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 --2- 172.21.15.18:0/3930553290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0e40b6190 0x7ff0e4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 >> 172.21.15.18:0/3930553290 conn(0x7ff0e40d1190 msgr2=0x7ff0e4160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 shutdown_connections 2024-04-16T12:56:10.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.801+0000 7ff0eb3a1640 1 -- 172.21.15.18:0/3930553290 wait complete. 2024-04-16T12:56:10.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T12:56:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.919+0000 7f0e8b814640 1 Processor -- start 2024-04-16T12:56:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.919+0000 7f0e8b814640 1 -- start start 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e8b814640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e840cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e8b814640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e840b3ec0 0x7f0e840d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e8b814640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e8415f100 con 0x7f0e840d4340 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e8b814640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0e840cf740 con 0x7f0e840b3ec0 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e8b814640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0e840cf8e0 con 0x7f0e8415ed20 2024-04-16T12:56:10.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e88daf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e840b3ec0 0x7f0e840d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e89db1640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0e840d4340 0x7f0e840b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43626/0 (socket says 172.21.15.18:43626) 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.920+0000 7f0e89db1640 1 -- 172.21.15.18:0/485692637 learned_addr learned my addr 172.21.15.18:0/485692637 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e895b0640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e840cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e88daf640 1 -- 172.21.15.18:0/485692637 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 msgr2=0x7f0e840cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e88daf640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e840cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e88daf640 1 -- 172.21.15.18:0/485692637 >> v1:172.21.15.18:6789/0 conn(0x7f0e840d4340 legacy=0x7f0e840b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e83fff640 1 -- 172.21.15.18:0/485692637 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241695632 0 0) 0x7f0e8415f100 con 0x7f0e840d4340 2024-04-16T12:56:10.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e88daf640 1 -- 172.21.15.18:0/485692637 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e840cfb30 con 0x7f0e840b3ec0 2024-04-16T12:56:10.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.921+0000 7f0e88daf640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840b3ec0 0x7f0e840d3e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0e780097a0 tx=0x7f0e7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb9bc59ed15f4f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e83fff640 1 -- 172.21.15.18:0/485692637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78035020 con 0x7f0e840b3ec0 2024-04-16T12:56:10.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e83fff640 1 -- 172.21.15.18:0/485692637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e78031830 con 0x7f0e840b3ec0 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e83fff640 1 -- 172.21.15.18:0/485692637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78031c00 con 0x7f0e840b3ec0 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 -- 172.21.15.18:0/485692637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840b3ec0 msgr2=0x7f0e840d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840b3ec0 0x7f0e840d3e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0e780097a0 tx=0x7f0e7802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 -- 172.21.15.18:0/485692637 shutdown_connections 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840b3ec0 0x7f0e840d3e00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 --2- 172.21.15.18:0/485692637 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e840cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 -- 172.21.15.18:0/485692637 >> 172.21.15.18:0/485692637 conn(0x7f0e840d1390 msgr2=0x7f0e840d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 -- 172.21.15.18:0/485692637 shutdown_connections 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.922+0000 7f0e8b814640 1 -- 172.21.15.18:0/485692637 wait complete. 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.923+0000 7f0e8b814640 1 Processor -- start 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.923+0000 7f0e8b814640 1 -- start start 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e840b3ec0 0x7f0e840c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e8415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e840d38e0 con 0x7f0e840d4340 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0e840d3600 con 0x7f0e840b3ec0 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e8b814640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0e840d00f0 con 0x7f0e8415ed20 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e88daf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e88daf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44408/0 (socket says 172.21.15.18:44408) 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.924+0000 7f0e88daf640 1 -- 172.21.15.18:0/4202474480 learned_addr learned my addr 172.21.15.18:0/4202474480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e895b0640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e840b3ec0 0x7f0e840c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e89db1640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e8415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 -- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 msgr2=0x7f0e8415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e8415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 -- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e840b3ec0 msgr2=0x7f0e840c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e840b3ec0 0x7f0e840c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 -- 172.21.15.18:0/4202474480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e840ca7c0 con 0x7f0e840d4340 2024-04-16T12:56:10.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e88daf640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0e78034040 tx=0x7f0e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78035040 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e78004250 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e8b814640 1 -- 172.21.15.18:0/4202474480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e840caaa0 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7803a700 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.925+0000 7f0e8b814640 1 -- 172.21.15.18:0/4202474480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e840cbcc0 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.926+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e840752b0 con 0x7f0e840d4340 2024-04-16T12:56:10.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.927+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e78038020 con 0x7f0e840d4340 2024-04-16T12:56:10.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.928+0000 7f0e81ffb640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 0x7f0e7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:10.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.928+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0e780ae100 con 0x7f0e840d4340 2024-04-16T12:56:10.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.928+0000 7f0e895b0640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 0x7f0e7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:10.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.929+0000 7f0e895b0640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 0x7f0e7006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006fd0 tx=0x7f0e7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:10.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:10.931+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e7807c1a0 con 0x7f0e840d4340 2024-04-16T12:56:11.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.156+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0e840b92f0 con 0x7f0e840d4340 2024-04-16T12:56:11.157 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-16T12:56:11.156+0000 7f9d3b5ec640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T12:56:11.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.157+0000 7f0e81ffb640 1 -- 172.21.15.18:0/4202474480 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f0e7807baa0 con 0x7f0e840d4340 2024-04-16T12:56:11.159 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 msgr2=0x7f0e7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 0x7f0e7006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006fd0 tx=0x7f0e7c008040 comp rx=0 tx=0).stop 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 msgr2=0x7f0e84157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0e78034040 tx=0x7f0e780046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 shutdown_connections 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0e7006c8f0 0x7f0e7006edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e8415ed20 0x7f0e8415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e840d4340 0x7f0e84157300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 --2- 172.21.15.18:0/4202474480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e840b3ec0 0x7f0e840c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 >> 172.21.15.18:0/4202474480 conn(0x7f0e840d1390 msgr2=0x7f0e840b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:11.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 shutdown_connections 2024-04-16T12:56:11.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.160+0000 7f0e6b7fe640 1 -- 172.21.15.18:0/4202474480 wait complete. 2024-04-16T12:56:11.164 INFO:tasks.ceph.mds.b.smithi104.stderr: -6559> 2024-04-16T12:55:02.110+0000 7fde9f5f6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-16T12:56:11.165 INFO:tasks.ceph.mds.b.smithi104.stderr: -5389> 2024-04-16T12:55:13.110+0000 7fde995ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:56:11.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T12:56:11.196 INFO:tasks.ceph.mds.b.smithi104.stdout:starting mds.b at 2024-04-16T12:56:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.278+0000 7f96ae860640 1 Processor -- start 2024-04-16T12:56:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.278+0000 7f96ae860640 1 -- start start 2024-04-16T12:56:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a8162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 0x7f96a80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96a80cfad0 0x7f96a806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f96a80d2f30 con 0x7f96a80cfad0 2024-04-16T12:56:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f96a80b7a60 con 0x7f96a80ba350 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96ae860640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f96a815ef40 con 0x7f96a815eb60 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96acdfd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96a80cfad0 0x7f96a806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96acdfd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96a80cfad0 0x7f96a806ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44410/0 (socket says 172.21.15.18:44410) 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.279+0000 7f96acdfd640 1 -- 172.21.15.18:0/1816844151 learned_addr learned my addr 172.21.15.18:0/1816844151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f969ffff640 1 --2- 172.21.15.18:0/1816844151 >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 0x7f96a80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96a7fff640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a8162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 -- 172.21.15.18:0/1816844151 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 msgr2=0x7f96a8162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a8162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 -- 172.21.15.18:0/1816844151 >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 msgr2=0x7f96a80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:11.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 --2- 172.21.15.18:0/1816844151 >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 0x7f96a80cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 -- 172.21.15.18:0/1816844151 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a8162d30 con 0x7f96a80cfad0 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96a7fff640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a8162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f969ffff640 1 --2- 172.21.15.18:0/1816844151 >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 0x7f96a80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.280+0000 7f96acdfd640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a806ba20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f96a806de60 tx=0x7f96a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb05ec051780ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96a77fe640 1 -- 172.21.15.18:0/1816844151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a002ca70 con 0x7f96a80cfad0 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96a77fe640 1 -- 172.21.15.18:0/1816844151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a002cc10 con 0x7f96a80cfad0 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96a77fe640 1 -- 172.21.15.18:0/1816844151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00343f0 con 0x7f96a80cfad0 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 -- 172.21.15.18:0/1816844151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 msgr2=0x7f96a806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a806ba20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f96a806de60 tx=0x7f96a002bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 -- 172.21.15.18:0/1816844151 shutdown_connections 2024-04-16T12:56:11.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 --2- 172.21.15.18:0/1816844151 >> v2:172.21.15.104:3300/0 conn(0x7f96a80ba350 0x7f96a80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a806ba20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 --2- 172.21.15.18:0/1816844151 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a8162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 -- 172.21.15.18:0/1816844151 >> 172.21.15.18:0/1816844151 conn(0x7f96a80b65b0 msgr2=0x7f96a80b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 -- 172.21.15.18:0/1816844151 shutdown_connections 2024-04-16T12:56:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.281+0000 7f96ae860640 1 -- 172.21.15.18:0/1816844151 wait complete. 2024-04-16T12:56:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.282+0000 7f96ae860640 1 Processor -- start 2024-04-16T12:56:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 -- start start 2024-04-16T12:56:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80ba350 0x7f96a81607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96a80ba7b0 con 0x7f96a80cfad0 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f96a81632f0 con 0x7f96a80ba350 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f96ae860640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f96a806bf60 con 0x7f96a815eb60 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f969ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f969ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44420/0 (socket says 172.21.15.18:44420) 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.283+0000 7f969ffff640 1 -- 172.21.15.18:0/1108191954 learned_addr learned my addr 172.21.15.18:0/1108191954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96a7fff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80ba350 0x7f96a81607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96acdfd640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 -- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 msgr2=0x7f96a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 -- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80ba350 msgr2=0x7f96a81607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80ba350 0x7f96a81607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 -- 172.21.15.18:0/1108191954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a815f710 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f969ffff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f969000e810 tx=0x7f969000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969000f040 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690004030 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a815f9f0 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690004400 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.284+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a8160290 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.285+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a80752b0 con 0x7f96a80cfad0 2024-04-16T12:56:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.286+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f969000c6d0 con 0x7f96a80cfad0 2024-04-16T12:56:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.286+0000 7f96a57fa640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 0x7f968806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.286+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f969008bbd0 con 0x7f96a80cfad0 2024-04-16T12:56:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.286+0000 7f96a7fff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 0x7f968806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.287+0000 7f96a7fff640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 0x7f968806ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9698006fd0 tx=0x7f9698008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.290+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9690017020 con 0x7f96a80cfad0 2024-04-16T12:56:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:11.513+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f96a8067da0 con 0x7f96a80cfad0 2024-04-16T12:56:12.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.159+0000 7f96a57fa640 1 -- 172.21.15.18:0/1108191954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f9690059c30 con 0x7f96a80cfad0 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 msgr2=0x7f968806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 0x7f968806ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9698006fd0 tx=0x7f9698008040 comp rx=0 tx=0).stop 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 msgr2=0x7f96a815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f969000e810 tx=0x7f969000ecd0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 shutdown_connections 2024-04-16T12:56:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f968806c920 0x7f968806ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f96a815eb60 0x7f96a80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a80cfad0 0x7f96a815f0f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 --2- 172.21.15.18:0/1108191954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80ba350 0x7f96a81607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 >> 172.21.15.18:0/1108191954 conn(0x7f96a80b65b0 msgr2=0x7f96a80b85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 shutdown_connections 2024-04-16T12:56:12.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.162+0000 7f96ae860640 1 -- 172.21.15.18:0/1108191954 wait complete. 2024-04-16T12:56:12.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T12:56:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.293+0000 7f818d6d3640 1 Processor -- start 2024-04-16T12:56:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.293+0000 7f818d6d3640 1 -- start start 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f818d6d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f818815e9e0 0x7f818806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f818d6d3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81880cfc60 0x7f81880d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f818d6d3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81880b79b0 con 0x7f81880ba1a0 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f818d6d3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f81880d2c50 con 0x7f81880cfc60 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f818d6d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f81880d2f30 con 0x7f818815e9e0 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81880cfc60 0x7f81880d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81880cfc60 0x7f81880d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44422/0 (socket says 172.21.15.18:44422) 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 -- 172.21.15.18:0/783752756 learned_addr learned my addr 172.21.15.18:0/783752756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81867fc640 1 --1- 172.21.15.18:0/783752756 >> v1:172.21.15.18:6789/0 conn(0x7f81880ba1a0 0x7f81880cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43642/0 (socket says 172.21.15.18:43642) 2024-04-16T12:56:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 -- 172.21.15.18:0/783752756 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f818815e9e0 msgr2=0x7f818806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:12.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 --2- 172.21.15.18:0/783752756 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f818815e9e0 0x7f818806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 -- 172.21.15.18:0/783752756 >> v1:172.21.15.18:6789/0 conn(0x7f81880ba1a0 legacy=0x7f81880cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.294+0000 7f81877fe640 1 -- 172.21.15.18:0/783752756 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818806c270 con 0x7f81880cfc60 2024-04-16T12:56:12.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.295+0000 7f81877fe640 1 --2- 172.21.15.18:0/783752756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81880d33c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8180009870 tx=0x7f818002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a67247e497f5fee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.295+0000 7f8185ffb640 1 -- 172.21.15.18:0/783752756 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180035020 con 0x7f81880cfc60 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.295+0000 7f8185ffb640 1 -- 172.21.15.18:0/783752756 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180031640 con 0x7f81880cfc60 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.295+0000 7f8185ffb640 1 -- 172.21.15.18:0/783752756 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818002d040 con 0x7f81880cfc60 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 -- 172.21.15.18:0/783752756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 msgr2=0x7f81880d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 --2- 172.21.15.18:0/783752756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81880d33c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8180009870 tx=0x7f818002b8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 -- 172.21.15.18:0/783752756 shutdown_connections 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 --2- 172.21.15.18:0/783752756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81880d33c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 --2- 172.21.15.18:0/783752756 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f818815e9e0 0x7f818806ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 -- 172.21.15.18:0/783752756 >> 172.21.15.18:0/783752756 conn(0x7f81880b6390 msgr2=0x7f81880b67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:12.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 -- 172.21.15.18:0/783752756 shutdown_connections 2024-04-16T12:56:12.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.296+0000 7f818d6d3640 1 -- 172.21.15.18:0/783752756 wait complete. 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.297+0000 7f818d6d3640 1 Processor -- start 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.297+0000 7f818d6d3640 1 -- start start 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f81880ba1a0 0x7f8188153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f818815e9e0 0x7f81881f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f818806bf60 con 0x7f81880cfc60 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f818806c830 con 0x7f818815e9e0 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f818d6d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f818815edc0 con 0x7f81880ba1a0 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44436/0 (socket says 172.21.15.18:44436) 2024-04-16T12:56:12.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 -- 172.21.15.18:0/1789688829 learned_addr learned my addr 172.21.15.18:0/1789688829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 -- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f81880ba1a0 msgr2=0x7f8188153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f81880ba1a0 0x7f8188153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 -- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f818815e9e0 msgr2=0x7f81881f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81877fe640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f818815e9e0 0x7f81881f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f818815e9e0 0x7f81881f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 -- 172.21.15.18:0/1789688829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8188155860 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.298+0000 7f81867fc640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.299+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700074e0 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.299+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8170007680 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.299+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8188153560 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.299+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170004a00 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.299+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81880cc0f0 con 0x7f81880cfc60 2024-04-16T12:56:12.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.300+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81880752b0 con 0x7f81880cfc60 2024-04-16T12:56:12.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.300+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f817001a020 con 0x7f81880cfc60 2024-04-16T12:56:12.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.300+0000 7f817f7fe640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 0x7f816806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:12.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.301+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f817008b750 con 0x7f81880cfc60 2024-04-16T12:56:12.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.301+0000 7f8186ffd640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 0x7f816806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:12.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.301+0000 7f8186ffd640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 0x7f816806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f817800ab90 tx=0x7f8178009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.305+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81880b79b0 con 0x7f81880cfc60 2024-04-16T12:56:12.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:12.489+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81880d2520 con 0x7f81880cfc60 2024-04-16T12:56:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.164+0000 7f817f7fe640 1 -- 172.21.15.18:0/1789688829 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f8170059720 con 0x7f81880cfc60 2024-04-16T12:56:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-16T12:56:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 msgr2=0x7f816806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 0x7f816806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f817800ab90 tx=0x7f8178009250 comp rx=0 tx=0).stop 2024-04-16T12:56:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 msgr2=0x7f81881f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f817000c3c0 tx=0x7f817000c880 comp rx=0 tx=0).stop 2024-04-16T12:56:13.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 shutdown_connections 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f816806c8f0 0x7f816806edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f818815e9e0 0x7f81881f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81880cfc60 0x7f81881f4f90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 --2- 172.21.15.18:0/1789688829 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f81880ba1a0 0x7f8188153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 >> 172.21.15.18:0/1789688829 conn(0x7f81880b6390 msgr2=0x7f81880b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 shutdown_connections 2024-04-16T12:56:13.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.168+0000 7f818d6d3640 1 -- 172.21.15.18:0/1789688829 wait complete. 2024-04-16T12:56:13.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T12:56:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.300+0000 7f71c6c88640 1 Processor -- start 2024-04-16T12:56:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.300+0000 7f71c6c88640 1 -- start start 2024-04-16T12:56:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c6c88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71c009b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c6c88640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c0071e30 con 0x7f71c00d1600 2024-04-16T12:56:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c6c88640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c0070e10 con 0x7f71c0071600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c6c88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00710f0 con 0x7f71c009b120 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c4a24640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f71c00d1600 0x7f71c009aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43646/0 (socket says 172.21.15.18:43646) 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71c4a24640 1 -- 172.21.15.18:0/3091327231 learned_addr learned my addr 172.21.15.18:0/3091327231 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965978517 0 0) 0x7f71c0071e30 con 0x7f71c00d1600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71a8003520 con 0x7f71c00d1600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b7fff640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71c009b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2156129973 0 0) 0x7f71a8003520 con 0x7f71c00d1600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 msgr2=0x7f71c009b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71c009b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 >> v1:172.21.15.104:6789/0 conn(0x7f71c0071600 legacy=0x7f71c006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c00d19e0 con 0x7f71c00d1600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f71bc001670 con 0x7f71c00d1600 2024-04-16T12:56:13.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 >> v1:172.21.15.18:6789/0 conn(0x7f71c00d1600 legacy=0x7f71c009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71a8003f60 0x7f71a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71a8004d40 0x7f71a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00710f0 con 0x7f71a8004d40 2024-04-16T12:56:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f71a800baa0 con 0x7f71a8003f60 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.301+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f71a800bca0 con 0x7f71c009b120 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71a8004d40 0x7f71a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c4a24640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71b7fff640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71a8003f60 0x7f71a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 -- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 msgr2=0x7f71a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71c009b120 0x7f71a80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 -- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71a8003f60 msgr2=0x7f71a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71a8003f60 0x7f71a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.302+0000 7f71c5225640 1 -- 172.21.15.18:0/3091327231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a8003520 con 0x7f71a8004d40 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c5225640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71a8004d40 0x7f71a80051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f71c0069230 tx=0x7f71a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ced7db4c3fc0fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8001a70 con 0x7f71a8004d40 2024-04-16T12:56:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8003b70 con 0x7f71a8004d40 2024-04-16T12:56:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71b77fe640 1 -- 172.21.15.18:0/3091327231 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b80050d0 con 0x7f71a8004d40 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 -- 172.21.15.18:0/3091327231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71a8004d40 msgr2=0x7f71a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 --2- 172.21.15.18:0/3091327231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71a8004d40 0x7f71a80051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f71c0069230 tx=0x7f71a8005830 comp rx=0 tx=0).stop 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c5225640 1 -- 172.21.15.18:0/3091327231 reap_dead start 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 -- 172.21.15.18:0/3091327231 shutdown_connections 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 -- 172.21.15.18:0/3091327231 >> 172.21.15.18:0/3091327231 conn(0x7f71c00d2600 msgr2=0x7f71c00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 -- 172.21.15.18:0/3091327231 shutdown_connections 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.303+0000 7f71c6c88640 1 -- 172.21.15.18:0/3091327231 wait complete. 2024-04-16T12:56:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.305+0000 7f71c6c88640 1 Processor -- start 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.305+0000 7f71c6c88640 1 -- start start 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.305+0000 7f71c6c88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 0x7f71c00c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 0x7f71c01513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71c009b8d0 con 0x7f71c00c7c60 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f71c009b750 con 0x7f71c0150f50 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f71c009ba50 con 0x7f71a8004d40 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44460/0 (socket says 172.21.15.18:44460) 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 -- 172.21.15.18:0/2936927890 learned_addr learned my addr 172.21.15.18:0/2936927890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c5225640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 0x7f71c01513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c4a24640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 0x7f71c00c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 -- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 msgr2=0x7f71c00c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 0x7f71c00c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 -- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 msgr2=0x7f71c01513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 0x7f71c01513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 -- 172.21.15.18:0/2936927890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c014e6a0 con 0x7f71c00c7c60 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c5225640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 0x7f71c01513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c4a24640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 0x7f71c00c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b7fff640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71b00119a0 tx=0x7f71b0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b000faf0 con 0x7f71c00c7c60 2024-04-16T12:56:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b000fc90 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c014ea20 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0014440 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.306+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c014ecc0 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.307+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c00c80c0 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.308+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71b0012040 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.308+0000 7f71b57fa640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 0x7f71ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.308+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7f71b008c520 con 0x7f71c00c7c60 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.308+0000 7f71c4a24640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 0x7f71ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:13.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.309+0000 7f71c4a24640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 0x7f71ac06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71bc001eb0 tx=0x7f71bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.312+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71c014e6a0 con 0x7f71c00c7c60 2024-04-16T12:56:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:13.497+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f71c00752b0 con 0x7f71c00c7c60 2024-04-16T12:56:14.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.166+0000 7f71b57fa640 1 -- 172.21.15.18:0/2936927890 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f71b0019030 con 0x7f71c00c7c60 2024-04-16T12:56:14.168 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 msgr2=0x7f71ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 0x7f71ac06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71bc001eb0 tx=0x7f71bc009040 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 msgr2=0x7f71c0150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f71b00119a0 tx=0x7f71b0011e60 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 shutdown_connections 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f71ac06c8f0 0x7f71ac06edb0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71bc001eb0 tx=0x7f71bc009040 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71c0150f50 0x7f71c01513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c00c7c60 0x7f71c0150a10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 --2- 172.21.15.18:0/2936927890 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f71a8004d40 0x7f71c00c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.169+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 >> 172.21.15.18:0/2936927890 conn(0x7f71c00d2600 msgr2=0x7f71c00b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:14.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.170+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 shutdown_connections 2024-04-16T12:56:14.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.170+0000 7f71c6c88640 1 -- 172.21.15.18:0/2936927890 wait complete. 2024-04-16T12:56:14.188 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-16T12:56:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.298+0000 7fb0dae0c640 1 Processor -- start 2024-04-16T12:56:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.298+0000 7fb0dae0c640 1 -- start start 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0dae0c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb0d409b120 0x7fb0d409b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0dae0c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d4071e30 con 0x7fb0d4071600 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0dae0c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d4070e10 con 0x7fb0d40d1600 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0dae0c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d40710f0 con 0x7fb0d409b120 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb0d409b120 0x7fb0d409b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0d93a9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb0d4071600 0x7fb0d406cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38684/0 (socket says 172.21.15.18:38684) 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0d93a9640 1 -- 172.21.15.18:0/2010166584 learned_addr learned my addr 172.21.15.18:0/2010166584 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cbfff640 1 --2- 172.21.15.18:0/2010166584 >> v2:172.21.15.18:3300/0 conn(0x7fb0d409b120 0x7fb0d409b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33994/0 (socket says 172.21.15.18:33994) 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cbfff640 1 -- 172.21.15.18:0/2010166584 >> v1:172.21.15.104:6789/0 conn(0x7fb0d40d1600 legacy=0x7fb0d409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cbfff640 1 -- 172.21.15.18:0/2010166584 >> v1:172.21.15.18:6789/0 conn(0x7fb0d4071600 legacy=0x7fb0d406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cb7fe640 1 -- 172.21.15.18:0/2010166584 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68460770 0 0) 0x7fb0d4071e30 con 0x7fb0d4071600 2024-04-16T12:56:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.299+0000 7fb0cbfff640 1 -- 172.21.15.18:0/2010166584 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40d19e0 con 0x7fb0d409b120 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.300+0000 7fb0cbfff640 1 --2- 172.21.15.18:0/2010166584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d409b120 0x7fb0d409b750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429c5c05444a735e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.300+0000 7fb0cb7fe640 1 -- 172.21.15.18:0/2010166584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4035020 con 0x7fb0d409b120 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.300+0000 7fb0cb7fe640 1 -- 172.21.15.18:0/2010166584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c4031830 con 0x7fb0d409b120 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.300+0000 7fb0cb7fe640 1 -- 172.21.15.18:0/2010166584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4031c00 con 0x7fb0d409b120 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2010166584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d409b120 msgr2=0x7fb0d409b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2010166584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d409b120 0x7fb0d409b750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2010166584 shutdown_connections 2024-04-16T12:56:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2010166584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d409b120 0x7fb0d409b750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2010166584 >> 172.21.15.18:0/2010166584 conn(0x7fb0d40d2600 msgr2=0x7fb0d40d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2010166584 shutdown_connections 2024-04-16T12:56:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.301+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2010166584 wait complete. 2024-04-16T12:56:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.302+0000 7fb0dae0c640 1 Processor -- start 2024-04-16T12:56:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.302+0000 7fb0dae0c640 1 -- start start 2024-04-16T12:56:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb0d4071600 0x7fb0d41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d409b120 0x7fb0d40b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d40d0810 con 0x7fb0d40d1600 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d40d0690 con 0x7fb0d409b120 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0dae0c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d40d0990 con 0x7fb0d4071600 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34004/0 (socket says 172.21.15.18:34004) 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 -- 172.21.15.18:0/2366942218 learned_addr learned my addr 172.21.15.18:0/2366942218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 -- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb0d4071600 msgr2=0x7fb0d41554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb0d4071600 0x7fb0d41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 -- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d409b120 msgr2=0x7fb0d40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d409b120 0x7fb0d40b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 -- 172.21.15.18:0/2366942218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40b5ca0 con 0x7fb0d40d1600 2024-04-16T12:56:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.303+0000 7fb0d93a9640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c440 tx=0x7fb0cc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.304+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0074e0 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.304+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0047e0 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.304+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d40b5f80 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.304+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc004bd0 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.304+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d40b6540 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.305+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40752b0 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.305+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0cc011070 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.306+0000 7fb0c97fa640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 0x7fb0c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.306+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fb0cc08b800 con 0x7fb0d40d1600 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.306+0000 7fb0d8ba8640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 0x7fb0c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.306+0000 7fb0d8ba8640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 0x7fb0c006edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000abb0 tx=0x7fb0d0009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.310+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0cc00e280 con 0x7fb0d40d1600 2024-04-16T12:56:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:14.495+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb0d40b0400 con 0x7fb0d40d1600 2024-04-16T12:56:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.181+0000 7fb0c97fa640 1 -- 172.21.15.18:0/2366942218 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fb0cc059b10 con 0x7fb0d40d1600 2024-04-16T12:56:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 msgr2=0x7fb0c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 0x7fb0c006edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000abb0 tx=0x7fb0d0009250 comp rx=0 tx=0).stop 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 msgr2=0x7fb0d40b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c440 tx=0x7fb0cc00c900 comp rx=0 tx=0).stop 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 shutdown_connections 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fb0c006c8f0 0x7fb0c006edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0d40d1600 0x7fb0d40b5220 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d409b120 0x7fb0d40b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 --2- 172.21.15.18:0/2366942218 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fb0d4071600 0x7fb0d41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 >> 172.21.15.18:0/2366942218 conn(0x7fb0d40d2600 msgr2=0x7fb0d40ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 shutdown_connections 2024-04-16T12:56:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.185+0000 7fb0dae0c640 1 -- 172.21.15.18:0/2366942218 wait complete. 2024-04-16T12:56:15.200 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T12:56:15.200 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T12:56:15.200 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T12:56:15.200 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:15.200 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T12:56:15.201 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T12:56:15.201 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T12:56:15.201 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:15.201 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T12:56:15.201 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T12:56:15.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T12:56:15.201 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:15.202 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T12:56:15.202 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T12:56:15.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T12:56:15.202 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:15.211 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T12:56:15.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T12:56:15.212 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T12:56:15.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T12:56:15.213 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T12:56:15.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T12:56:15.214 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T12:56:15.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T12:56:15.255 INFO:tasks.ceph.mds.a:Started 2024-04-16T12:56:15.256 INFO:tasks.ceph.mds.c:Started 2024-04-16T12:56:15.256 DEBUG:teuthology.parallel:result is None 2024-04-16T12:56:15.256 DEBUG:teuthology.parallel:result is None 2024-04-16T12:56:15.257 INFO:tasks.ceph.mds.b:Started 2024-04-16T12:56:15.257 DEBUG:teuthology.parallel:result is None 2024-04-16T12:56:15.257 INFO:tasks.ceph.mds.d:Started 2024-04-16T12:56:15.257 DEBUG:teuthology.parallel:result is None 2024-04-16T12:56:15.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T12:56:15.337 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-16T12:56:15.337 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-16T12:56:15.343 INFO:tasks.ceph.mds.b.smithi104.stdout:starting mds.b at 2024-04-16T12:56:15.343 INFO:tasks.ceph.mds.d.smithi104.stdout:starting mds.d at 2024-04-16T12:56:15.344 INFO:tasks.ceph.mds.d.smithi104.stderr:2024-04-16T12:56:15.343+0000 7f643df3b640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-16T12:56:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.370+0000 7fab8e274640 1 Processor -- start 2024-04-16T12:56:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.370+0000 7fab8e274640 1 -- start start 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8e274640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab8815ed20 0x7fab880cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8e274640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b6390 0x7fab880b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8e274640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8815f100 con 0x7fab880b3ec0 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8e274640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fab880cf740 con 0x7fab8815ed20 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8e274640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fab880cf8e0 con 0x7fab880b6390 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab87fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab8815ed20 0x7fab880cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab87fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab8815ed20 0x7fab880cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34036/0 (socket says 172.21.15.18:34036) 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab87fff640 1 -- 172.21.15.18:0/4287429247 learned_addr learned my addr 172.21.15.18:0/4287429247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.371+0000 7fab8c811640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b6390 0x7fab880b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab87fff640 1 -- 172.21.15.18:0/4287429247 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b6390 msgr2=0x7fab880b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab87fff640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b6390 0x7fab880b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab87fff640 1 -- 172.21.15.18:0/4287429247 >> v1:172.21.15.104:6789/0 conn(0x7fab880b3ec0 legacy=0x7fab880d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab87fff640 1 -- 172.21.15.18:0/4287429247 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cfb30 con 0x7fab8815ed20 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab87fff640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab8815ed20 0x7fab880cf200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab78009870 tx=0x7fab7802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07929ae435dbe46 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.372+0000 7fab86ffd640 1 -- 172.21.15.18:0/4287429247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78034070 con 0x7fab8815ed20 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab86ffd640 1 -- 172.21.15.18:0/4287429247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78030840 con 0x7fab8815ed20 2024-04-16T12:56:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab86ffd640 1 -- 172.21.15.18:0/4287429247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78030c10 con 0x7fab8815ed20 2024-04-16T12:56:15.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 -- 172.21.15.18:0/4287429247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab8815ed20 msgr2=0x7fab880cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab8815ed20 0x7fab880cf200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab78009870 tx=0x7fab7802b980 comp rx=0 tx=0).stop 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 -- 172.21.15.18:0/4287429247 shutdown_connections 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b6390 0x7fab880b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 --2- 172.21.15.18:0/4287429247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab8815ed20 0x7fab880cf200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 -- 172.21.15.18:0/4287429247 >> 172.21.15.18:0/4287429247 conn(0x7fab880d1390 msgr2=0x7fab880d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 -- 172.21.15.18:0/4287429247 shutdown_connections 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.373+0000 7fab8e274640 1 -- 172.21.15.18:0/4287429247 wait complete. 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.374+0000 7fab8e274640 1 Processor -- start 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.374+0000 7fab8e274640 1 -- start start 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b3ec0 0x7fab880ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab8815ed20 0x7fab881f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d38e0 con 0x7fab880b6390 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d3600 con 0x7fab8815ed20 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8e274640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fab880d00f0 con 0x7fab880b3ec0 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34038/0 (socket says 172.21.15.18:34038) 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 -- 172.21.15.18:0/1171285703 learned_addr learned my addr 172.21.15.18:0/1171285703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab87fff640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b3ec0 0x7fab880ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab8c811640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab8815ed20 0x7fab881f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 -- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b3ec0 msgr2=0x7fab880ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b3ec0 0x7fab880ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 -- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab8815ed20 msgr2=0x7fab881f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.375+0000 7fab877fe640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab8815ed20 0x7fab881f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab877fe640 1 -- 172.21.15.18:0/1171285703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cbee0 con 0x7fab880b6390 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab877fe640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c400 tx=0x7fab7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c017070 con 0x7fab880b6390 2024-04-16T12:56:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c0052d0 con 0x7fab880b6390 2024-04-16T12:56:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c003830 con 0x7fab880b6390 2024-04-16T12:56:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab880cc1c0 con 0x7fab880b6390 2024-04-16T12:56:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.376+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab880cc780 con 0x7fab880b6390 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.377+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab880752b0 con 0x7fab880b6390 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.377+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab7c01a070 con 0x7fab880b6390 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.378+0000 7fab84ff9640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 0x7fab7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.378+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7fab7c08ac00 con 0x7fab880b6390 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.378+0000 7fab87fff640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 0x7fab7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.378+0000 7fab87fff640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 0x7fab7406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab78036000 tx=0x7fab7803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:15.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.382+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab7c091080 con 0x7fab880b6390 2024-04-16T12:56:15.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:15.578+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fab880b5890 con 0x7fab880b6390 2024-04-16T12:56:16.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.200+0000 7fab84ff9640 1 -- 172.21.15.18:0/1171285703 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7fab7c059230 con 0x7fab880b6390 2024-04-16T12:56:16.201 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-16T12:56:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 msgr2=0x7fab7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 0x7fab7406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab78036000 tx=0x7fab7803b040 comp rx=0 tx=0).stop 2024-04-16T12:56:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 msgr2=0x7fab880ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c400 tx=0x7fab7c00c8c0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 shutdown_connections 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fab7406c920 0x7fab7406ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab8815ed20 0x7fab881f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab880b6390 0x7fab880ce290 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 --2- 172.21.15.18:0/1171285703 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab880b3ec0 0x7fab880ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 >> 172.21.15.18:0/1171285703 conn(0x7fab880d1390 msgr2=0x7fab880b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 shutdown_connections 2024-04-16T12:56:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.203+0000 7fab8e274640 1 -- 172.21.15.18:0/1171285703 wait complete. 2024-04-16T12:56:16.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T12:56:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.322+0000 7f7ed373d640 1 Processor -- start 2024-04-16T12:56:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 -- start start 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ecc15c820 0x7f7ecc1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ecc15cc00 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7ecc0b4b20 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed373d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f7ecc160a30 con 0x7f7ecc15c820 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed0cd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed0cd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34052/0 (socket says 172.21.15.18:34052) 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.323+0000 7f7ed0cd8640 1 -- 172.21.15.18:0/4209743111 learned_addr learned my addr 172.21.15.18:0/4209743111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.324+0000 7f7ed14d9640 1 --2- 172.21.15.18:0/4209743111 >> v2:172.21.15.104:3300/0 conn(0x7f7ecc15c820 0x7f7ecc1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.324+0000 7f7ed0cd8640 1 -- 172.21.15.18:0/4209743111 >> v2:172.21.15.104:3300/0 conn(0x7f7ecc15c820 msgr2=0x7f7ecc1603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.324+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/4209743111 >> v2:172.21.15.104:3300/0 conn(0x7f7ecc15c820 0x7f7ecc1603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.324+0000 7f7ed0cd8640 1 -- 172.21.15.18:0/4209743111 >> v1:172.21.15.104:6789/0 conn(0x7f7ecc0b46f0 legacy=0x7f7ecc06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.324+0000 7f7ed0cd8640 1 -- 172.21.15.18:0/4209743111 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc160d10 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/4209743111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0d02b0 tx=0x7f7ec002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23711df7213f139 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ecbfff640 1 -- 172.21.15.18:0/4209743111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec002e070 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ecbfff640 1 -- 172.21.15.18:0/4209743111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec0037070 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ecbfff640 1 -- 172.21.15.18:0/4209743111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0031a00 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 -- 172.21.15.18:0/4209743111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0ccd80 msgr2=0x7f7ecc0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 --2- 172.21.15.18:0/4209743111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0d02b0 tx=0x7f7ec002b880 comp rx=0 tx=0).stop 2024-04-16T12:56:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 -- 172.21.15.18:0/4209743111 shutdown_connections 2024-04-16T12:56:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 --2- 172.21.15.18:0/4209743111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc0b41b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 --2- 172.21.15.18:0/4209743111 >> v2:172.21.15.104:3300/0 conn(0x7f7ecc15c820 0x7f7ecc1603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 -- 172.21.15.18:0/4209743111 >> 172.21.15.18:0/4209743111 conn(0x7f7ecc0cf1b0 msgr2=0x7f7ecc0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 -- 172.21.15.18:0/4209743111 shutdown_connections 2024-04-16T12:56:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.325+0000 7f7ed373d640 1 -- 172.21.15.18:0/4209743111 wait complete. 2024-04-16T12:56:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 Processor -- start 2024-04-16T12:56:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 -- start start 2024-04-16T12:56:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc1e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ecc15c820 0x7f7ecc15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc0b8260 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc1612d0 con 0x7f7ecc0ccd80 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed373d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc0d18d0 con 0x7f7ecc15c820 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed14d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed14d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34060/0 (socket says 172.21.15.18:34060) 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.327+0000 7f7ed14d9640 1 -- 172.21.15.18:0/931617029 learned_addr learned my addr 172.21.15.18:0/931617029 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed1cda640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ecc15c820 0x7f7ecc15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc1e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 -- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ecc15c820 msgr2=0x7f7ecc15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ecc15c820 0x7f7ecc15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 -- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 msgr2=0x7f7ecc1e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc1e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 -- 172.21.15.18:0/931617029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc152000 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc1e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed14d9640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400d5f0 tx=0x7f7ec400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40125f0 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec4019070 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc159480 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40129d0 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.328+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc159d20 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.329+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc068a70 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.330+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ec4012b70 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.330+0000 7f7ec9ffb640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 0x7f7eb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.330+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f7ec408bdd0 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.331+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 0x7f7eb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.331+0000 7f7ed0cd8640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 0x7f7eb806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0036000 tx=0x7f7ec003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.334+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ec405a320 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.596+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7ecc0cff70 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.597+0000 7f7ec9ffb640 1 -- 172.21.15.18:0/931617029 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v7) ==== 80+0+6645 (secure 0 0 0) 0x7f7ec4059c20 con 0x7f7ecc0b46f0 2024-04-16T12:56:16.598 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mh+PhChAA6REyczyZ8C29DaMWaSb/XQ==", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-16T12:56:16.599 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5medYxGBAAJOkPNbQuQhLwzUd2IqsUVg==", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mHuqnEhAAie2gNKWh8ofjiVhlw+skVg==", 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.600 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mpBDVHxAA11m64DDO7u1yP/FITsFjoA==", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDxdB5m3udFCxAAHUz9NajeHygA280TMvWuiQ==", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQD0dB5mDwGFChAAVTMqgqr0q5jhbnf2Y1cz1g==", 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.602 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQD3dB5miDWaCRAAzjMdwEgTWGewfcaPvI99PQ==", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-16T12:56:16.603 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQD6dB5munFVCBAA32AeqtGoRUixdJpf/Uibmg==", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAAdR5mwnzeEBAAlEJNHRcTetPZP9uCnJOW5w==", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQADdR5meyjHDxAAonZdTy5FF3oHPSQtfNoXNQ==", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAGdR5mMenaDhAAuN9ijvvKCtgB30d4DV4DVg==", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAJdR5mtuxkDRAA6b0XI3yPfCvyRWjT3GouPA==", 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-16T12:56:16.606 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mScpUJBAAg92NknOEgwOgxRDmtBQiFA==", 2024-04-16T12:56:16.607 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.607 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.607 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-16T12:56:16.607 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-16T12:56:16.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-16T12:56:16.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.608 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5m7GfsLRAAG8t/E/1ICOiV/Ztr0wP1sA==", 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.609 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5msRhKKhAAe2E5w8hxs8naGLC5aHphbw==", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mUkl8MRAA3giH0rzdMor0DjXpDvDhww==", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-16T12:56:16.610 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDudB5mIbJhKBAA8QfuPS/Wni4zJ82yPARH5g==", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mds", 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5mz0CcEBAA6ey4evywbBNikwsQOiiRng==", 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5mDUmcEBAABM2EvdRzYmZbbtG2iOEC2w==", 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.612 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-osd", 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5mok+cEBAALqrYC9EUXaG/m2phIozGMA==", 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5mCVacEBAAa0Auayn9Y/b3dkcn7nwxCw==", 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.613 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5m81ycEBAAoUtvYyypKrUw/1smxKtvLQ==", 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAUdR5mxmOcEBAA38Tfqyk3Ax2jCmx4nkOBzQ==", 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-16T12:56:16.614 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5mxkJOBxAAtF9N0xBKy6v98AFpWjNaeQ==", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQDvdB5m1xJfAxAA5j4qhh5/QzTptJcne/pWpw==", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:16.616 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-16T12:56:16.616 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:16.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 msgr2=0x7f7eb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 0x7f7eb806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0036000 tx=0x7f7ec003d040 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 msgr2=0x7f7ecc151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400d5f0 tx=0x7f7ec400dab0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 shutdown_connections 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f7eb806c8f0 0x7f7eb806edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f7ecc15c820 0x7f7ecc15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ecc0ccd80 0x7f7ecc1e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 --2- 172.21.15.18:0/931617029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ecc0b46f0 0x7f7ecc151ac0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 >> 172.21.15.18:0/931617029 conn(0x7f7ecc0cf1b0 msgr2=0x7f7ecc0b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 shutdown_connections 2024-04-16T12:56:16.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.599+0000 7f7ed373d640 1 -- 172.21.15.18:0/931617029 wait complete. 2024-04-16T12:56:16.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T12:56:16.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.725+0000 7feb1cad9640 1 Processor -- start 2024-04-16T12:56:16.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.725+0000 7feb1cad9640 1 -- start start 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.725+0000 7feb1cad9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb1815ee20 0x7feb180b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1cad9640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1cad9640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1806e4b0 con 0x7feb180ce030 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1cad9640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7feb180b0b40 con 0x7feb1815ee20 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1cad9640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7feb180b0e20 con 0x7feb18070300 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb0ffff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb1815ee20 0x7feb180b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb0ffff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:57372/0 (socket says 172.21.15.18:57372) 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb1815ee20 0x7feb180b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:47766/0 (socket says 172.21.15.18:47766) 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb0ffff640 1 -- 172.21.15.18:0/87832842 learned_addr learned my addr 172.21.15.18:0/87832842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:16.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb16d9d640 1 --1- 172.21.15.18:0/87832842 >> v1:172.21.15.104:6789/0 conn(0x7feb180ce030 0x7feb180ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:45648/0 (socket says 172.21.15.18:45648) 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 -- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 msgr2=0x7feb18070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 -- 172.21.15.18:0/87832842 >> v1:172.21.15.104:6789/0 conn(0x7feb180ce030 legacy=0x7feb180ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb15d9b640 1 -- 172.21.15.18:0/87832842 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692555130 0 0) 0x7feb1806e4b0 con 0x7feb180ce030 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb1659c640 1 -- 172.21.15.18:0/87832842 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb180cf5c0 con 0x7feb1815ee20 2024-04-16T12:56:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.726+0000 7feb0ffff640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.727+0000 7feb1659c640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb1815ee20 0x7feb180b6cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb080097a0 tx=0x7feb0802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cffc7475ce9571f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.727+0000 7feb15d9b640 1 -- 172.21.15.18:0/87832842 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08035020 con 0x7feb1815ee20 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.727+0000 7feb15d9b640 1 -- 172.21.15.18:0/87832842 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb08031830 con 0x7feb1815ee20 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.727+0000 7feb15d9b640 1 -- 172.21.15.18:0/87832842 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08031c00 con 0x7feb1815ee20 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 -- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb1815ee20 msgr2=0x7feb180b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb1815ee20 0x7feb180b6cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb080097a0 tx=0x7feb0802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 -- 172.21.15.18:0/87832842 shutdown_connections 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 --2- 172.21.15.18:0/87832842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb1815ee20 0x7feb180b6cb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 -- 172.21.15.18:0/87832842 >> 172.21.15.18:0/87832842 conn(0x7feb1809aa10 msgr2=0x7feb180b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:16.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 -- 172.21.15.18:0/87832842 shutdown_connections 2024-04-16T12:56:16.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.728+0000 7feb1cad9640 1 -- 172.21.15.18:0/87832842 wait complete. 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.729+0000 7feb1cad9640 1 Processor -- start 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.729+0000 7feb1cad9640 1 -- start start 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 0x7feb1809b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb180b0810 con 0x7feb1815ee20 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb180cfb80 con 0x7feb180ce030 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1cad9640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7feb18070ca0 con 0x7feb18070300 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb16d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb16d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34074/0 (socket says 172.21.15.18:34074) 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb16d9d640 1 -- 172.21.15.18:0/692911853 learned_addr learned my addr 172.21.15.18:0/692911853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb1659c640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.730+0000 7feb0ffff640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 0x7feb1809b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 -- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 msgr2=0x7feb18155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 -- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 msgr2=0x7feb1809b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 0x7feb1809b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 -- 172.21.15.18:0/692911853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1809c060 con 0x7feb1815ee20 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb0ffff640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 0x7feb1809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb16d9d640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c7d0 tx=0x7feb1000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10018070 con 0x7feb1815ee20 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1809c340 con 0x7feb1815ee20 2024-04-16T12:56:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1000a640 con 0x7feb1815ee20 2024-04-16T12:56:16.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1000aa70 con 0x7feb1815ee20 2024-04-16T12:56:16.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.731+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1809f2a0 con 0x7feb1815ee20 2024-04-16T12:56:16.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.732+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb18068a70 con 0x7feb1815ee20 2024-04-16T12:56:16.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.733+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb1000ac10 con 0x7feb1815ee20 2024-04-16T12:56:16.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.733+0000 7feb0effd640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 0x7feaf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:16.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.733+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7feb1008afc0 con 0x7feb1815ee20 2024-04-16T12:56:16.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.733+0000 7feb1659c640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 0x7feaf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:16.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.734+0000 7feb1659c640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 0x7feaf806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb08036000 tx=0x7feb08008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:16.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.738+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb100595c0 con 0x7feb1815ee20 2024-04-16T12:56:16.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.994+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7feb1806f2d0 con 0x7feb1815ee20 2024-04-16T12:56:16.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.996+0000 7feb0effd640 1 -- 172.21.15.18:0/692911853 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7feb10058ec0 con 0x7feb1815ee20 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 msgr2=0x7feaf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 0x7feaf806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb08036000 tx=0x7feb08008030 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 msgr2=0x7feb180d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c7d0 tx=0x7feb1000cc90 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 shutdown_connections 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7feaf806c8f0 0x7feaf806edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1815ee20 0x7feb180d06d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb180ce030 0x7feb1809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 --2- 172.21.15.18:0/692911853 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7feb18070300 0x7feb18155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 >> 172.21.15.18:0/692911853 conn(0x7feb1809aa10 msgr2=0x7feb180b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 shutdown_connections 2024-04-16T12:56:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:16.998+0000 7feb1cad9640 1 -- 172.21.15.18:0/692911853 wait complete. 2024-04-16T12:56:17.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T12:56:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.116+0000 7f6fbae14640 1 Processor -- start 2024-04-16T12:56:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.116+0000 7f6fbae14640 1 -- start start 2024-04-16T12:56:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fbae14640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6fb415b8e0 0x7f6fb406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fbae14640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fbae14640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb40cea20 con 0x7f6fb406d740 2024-04-16T12:56:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fbae14640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb40ced00 con 0x7f6fb415b8e0 2024-04-16T12:56:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fbae14640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb4070d20 con 0x7f6fb406e290 2024-04-16T12:56:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fb93b1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fb8bb0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6fb415b8e0 0x7f6fb406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fb93b1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:57392/0 (socket says 172.21.15.18:57392) 2024-04-16T12:56:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.117+0000 7f6fb93b1640 1 -- 172.21.15.18:0/2108585286 learned_addr learned my addr 172.21.15.18:0/2108585286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb8bb0640 1 -- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 msgr2=0x7f6fb406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb8bb0640 1 -- 172.21.15.18:0/2108585286 >> v1:172.21.15.104:6789/0 conn(0x7f6fb406d740 legacy=0x7f6fb40cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb37fe640 1 -- 172.21.15.18:0/2108585286 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674350314 0 0) 0x7f6fb40cea20 con 0x7f6fb406d740 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb8bb0640 1 -- 172.21.15.18:0/2108585286 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb4070940 con 0x7f6fb415b8e0 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb93b1640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.118+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb415b8e0 0x7f6fb406dd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80097a0 tx=0x7f6fa802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897fb36c97bcbb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fb37fe640 1 -- 172.21.15.18:0/2108585286 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8035020 con 0x7f6fb415b8e0 2024-04-16T12:56:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fb37fe640 1 -- 172.21.15.18:0/2108585286 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8031830 con 0x7f6fb415b8e0 2024-04-16T12:56:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fb37fe640 1 -- 172.21.15.18:0/2108585286 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8031c00 con 0x7f6fb415b8e0 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 -- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb415b8e0 msgr2=0x7f6fb406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb415b8e0 0x7f6fb406dd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80097a0 tx=0x7f6fa802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 -- 172.21.15.18:0/2108585286 shutdown_connections 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb406e290 0x7f6fb406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 --2- 172.21.15.18:0/2108585286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb415b8e0 0x7f6fb406dd50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 -- 172.21.15.18:0/2108585286 >> 172.21.15.18:0/2108585286 conn(0x7f6fb409aa10 msgr2=0x7f6fb40b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 -- 172.21.15.18:0/2108585286 shutdown_connections 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.119+0000 7f6fbae14640 1 -- 172.21.15.18:0/2108585286 wait complete. 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.120+0000 7f6fbae14640 1 Processor -- start 2024-04-16T12:56:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.120+0000 7f6fbae14640 1 -- start start 2024-04-16T12:56:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 0x7f6fb40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb415b8e0 0x7f6fb40cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb415be40 con 0x7f6fb406e290 2024-04-16T12:56:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb415bcc0 con 0x7f6fb406d740 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fbae14640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb40b3890 con 0x7f6fb415b8e0 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.121+0000 7f6fb3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34078/0 (socket says 172.21.15.18:34078) 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 -- 172.21.15.18:0/197735449 learned_addr learned my addr 172.21.15.18:0/197735449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb93b1640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb415b8e0 0x7f6fb40cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 0x7f6fb40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 -- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb415b8e0 msgr2=0x7f6fb40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb415b8e0 0x7f6fb40cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 -- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 msgr2=0x7f6fb40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 0x7f6fb40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 -- 172.21.15.18:0/197735449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb40c6310 con 0x7f6fb406e290 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 0x7f6fb40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb3fff640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000c410 tx=0x7f6fa000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0017070 con 0x7f6fb406e290 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa00035f0 con 0x7f6fb406e290 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb40c65f0 con 0x7f6fb406e290 2024-04-16T12:56:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00039e0 con 0x7f6fb406e290 2024-04-16T12:56:17.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.122+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb40c9870 con 0x7f6fb406e290 2024-04-16T12:56:17.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.123+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb40c95e0 con 0x7f6fb406e290 2024-04-16T12:56:17.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.124+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fa001a070 con 0x7f6fb406e290 2024-04-16T12:56:17.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.124+0000 7f6fb17fa640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 0x7f6f9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.125+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f6fa008ad90 con 0x7f6fb406e290 2024-04-16T12:56:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.125+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 0x7f6f9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.125+0000 7f6fb8bb0640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 0x7f6f9806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036000 tx=0x7f6fa8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.129+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fa0059410 con 0x7f6fb406e290 2024-04-16T12:56:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.424+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f6fb40c6dc0 con 0x7f6fb406e290 2024-04-16T12:56:17.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.426+0000 7f6fb17fa640 1 -- 172.21.15.18:0/197735449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f6fa0058d10 con 0x7f6fb406e290 2024-04-16T12:56:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 msgr2=0x7f6f9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 0x7f6f9806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8036000 tx=0x7f6fa8008030 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 msgr2=0x7f6fb414e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000c410 tx=0x7f6fa000c8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 shutdown_connections 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9806c8f0 0x7f6f9806edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fb415b8e0 0x7f6fb40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fb406e290 0x7f6fb414e9b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 --2- 172.21.15.18:0/197735449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fb406d740 0x7f6fb40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 >> 172.21.15.18:0/197735449 conn(0x7f6fb409aa10 msgr2=0x7f6fb406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 shutdown_connections 2024-04-16T12:56:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.428+0000 7f6fbae14640 1 -- 172.21.15.18:0/197735449 wait complete. 2024-04-16T12:56:17.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T12:56:17.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.545+0000 7f0691b66640 1 Processor -- start 2024-04-16T12:56:17.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.545+0000 7f0691b66640 1 -- start start 2024-04-16T12:56:17.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.546+0000 7f0691b66640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f068c0b3ec0 0x7f068c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.546+0000 7f0691b66640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c15f100 con 0x7f068c0b6390 2024-04-16T12:56:17.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.546+0000 7f0691b66640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c0cfb30 con 0x7f068c15ed20 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.546+0000 7f0691b66640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f068c0cf740 con 0x7f068c0b3ec0 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f068c0b3ec0 0x7f068c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f068c0b6390 0x7f068c0b7b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38700/0 (socket says 172.21.15.18:38700) 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068bfff640 1 -- 172.21.15.18:0/314398605 learned_addr learned my addr 172.21.15.18:0/314398605 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068affd640 1 -- 172.21.15.18:0/314398605 >> v1:172.21.15.104:6789/0 conn(0x7f068c15ed20 legacy=0x7f068c0d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068affd640 1 -- 172.21.15.18:0/314398605 >> v1:172.21.15.18:6789/0 conn(0x7f068c0b6390 legacy=0x7f068c0b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068affd640 1 -- 172.21.15.18:0/314398605 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0cfe10 con 0x7f068c0b3ec0 2024-04-16T12:56:17.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.547+0000 7f068a7fc640 1 -- 172.21.15.18:0/314398605 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164909831 0 0) 0x7f068c15f100 con 0x7f068c0b6390 2024-04-16T12:56:17.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f068affd640 1 --2- 172.21.15.18:0/314398605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b3ec0 0x7f068c0cf200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f06800097a0 tx=0x7f068002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d60933a6943eb62 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f068a7fc640 1 -- 172.21.15.18:0/314398605 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680034070 con 0x7f068c0b3ec0 2024-04-16T12:56:17.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f068a7fc640 1 -- 172.21.15.18:0/314398605 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0680030610 con 0x7f068c0b3ec0 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f068a7fc640 1 -- 172.21.15.18:0/314398605 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800309e0 con 0x7f068c0b3ec0 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f0691b66640 1 -- 172.21.15.18:0/314398605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b3ec0 msgr2=0x7f068c0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.548+0000 7f0691b66640 1 --2- 172.21.15.18:0/314398605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b3ec0 0x7f068c0cf200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f06800097a0 tx=0x7f068002b960 comp rx=0 tx=0).stop 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.549+0000 7f0691b66640 1 -- 172.21.15.18:0/314398605 shutdown_connections 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.549+0000 7f0691b66640 1 --2- 172.21.15.18:0/314398605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b3ec0 0x7f068c0cf200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.549+0000 7f0691b66640 1 -- 172.21.15.18:0/314398605 >> 172.21.15.18:0/314398605 conn(0x7f068c0d1390 msgr2=0x7f068c0d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.549+0000 7f0691b66640 1 -- 172.21.15.18:0/314398605 shutdown_connections 2024-04-16T12:56:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.549+0000 7f0691b66640 1 -- 172.21.15.18:0/314398605 wait complete. 2024-04-16T12:56:17.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.550+0000 7f0691b66640 1 Processor -- start 2024-04-16T12:56:17.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.551+0000 7f0691b66640 1 -- start start 2024-04-16T12:56:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f068c0b3ec0 0x7f068c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f068c15ed20 0x7f068c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f068c0d38e0 con 0x7f068c0b6390 2024-04-16T12:56:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f068c0cf8e0 con 0x7f068c15ed20 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f0691b66640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0d00f0 con 0x7f068c0b3ec0 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34100/0 (socket says 172.21.15.18:34100) 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 -- 172.21.15.18:0/3018985770 learned_addr learned my addr 172.21.15.18:0/3018985770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068bfff640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f068c15ed20 0x7f068c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068b7fe640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f068c0b3ec0 0x7f068c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 -- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f068c0b3ec0 msgr2=0x7f068c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f068c0b3ec0 0x7f068c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 -- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f068c15ed20 msgr2=0x7f068c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f068c15ed20 0x7f068c14fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 -- 172.21.15.18:0/3018985770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0ccaf0 con 0x7f068c0b6390 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.552+0000 7f068affd640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f06800097a0 tx=0x7f06800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.553+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680047070 con 0x7f068c0b6390 2024-04-16T12:56:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.553+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0680004030 con 0x7f068c0b6390 2024-04-16T12:56:17.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.553+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c0ccdd0 con 0x7f068c0b6390 2024-04-16T12:56:17.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.553+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680034040 con 0x7f068c0b6390 2024-04-16T12:56:17.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.553+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c0cd390 con 0x7f068c0b6390 2024-04-16T12:56:17.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.554+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c067a10 con 0x7f068c0b6390 2024-04-16T12:56:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.554+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f068004a070 con 0x7f068c0b6390 2024-04-16T12:56:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.555+0000 7f0673fff640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 0x7f067806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.555+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f06800ad4c0 con 0x7f068c0b6390 2024-04-16T12:56:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.555+0000 7f068b7fe640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 0x7f067806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.556+0000 7f068b7fe640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 0x7f067806ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f067c000f60 tx=0x7f067c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.559+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f068c067a10 con 0x7f068c0b6390 2024-04-16T12:56:17.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.819+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f068c0752b0 con 0x7f068c0b6390 2024-04-16T12:56:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.821+0000 7f0673fff640 1 -- 172.21.15.18:0/3018985770 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f068007ba20 con 0x7f068c0b6390 2024-04-16T12:56:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 msgr2=0x7f067806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 0x7f067806ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f067c000f60 tx=0x7f067c009040 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 msgr2=0x7f068c1608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f06800097a0 tx=0x7f06800046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 shutdown_connections 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f067806c920 0x7f067806ede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f068c15ed20 0x7f068c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f068c0b6390 0x7f068c1608d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 --2- 172.21.15.18:0/3018985770 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f068c0b3ec0 0x7f068c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.824+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 >> 172.21.15.18:0/3018985770 conn(0x7f068c0d1390 msgr2=0x7f068c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.825+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 shutdown_connections 2024-04-16T12:56:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.825+0000 7f0691b66640 1 -- 172.21.15.18:0/3018985770 wait complete. 2024-04-16T12:56:17.837 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T12:56:17.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.941+0000 7f31c7b00640 1 Processor -- start 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.941+0000 7f31c7b00640 1 -- start start 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f31c015c5a0 0x7f31c0163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c00cb990 0x7f31c00cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31c015ef80 0x7f31c015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f31c00cc310 con 0x7f31c015ef80 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f31c015c980 con 0x7f31c015c5a0 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c7b00640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31c0072180 con 0x7f31c00cb990 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c609d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31c015ef80 0x7f31c015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c609d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31c015ef80 0x7f31c015f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34108/0 (socket says 172.21.15.18:34108) 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c609d640 1 -- 172.21.15.18:0/594681033 learned_addr learned my addr 172.21.15.18:0/594681033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c509b640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c00cb990 0x7f31c00cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.942+0000 7f31c589c640 1 --2- 172.21.15.18:0/594681033 >> v2:172.21.15.104:3300/0 conn(0x7f31c015c5a0 0x7f31c0163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 -- 172.21.15.18:0/594681033 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c00cb990 msgr2=0x7f31c00cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c00cb990 0x7f31c00cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 -- 172.21.15.18:0/594681033 >> v2:172.21.15.104:3300/0 conn(0x7f31c015c5a0 msgr2=0x7f31c0163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 --2- 172.21.15.18:0/594681033 >> v2:172.21.15.104:3300/0 conn(0x7f31c015c5a0 0x7f31c0163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 -- 172.21.15.18:0/594681033 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c015f8f0 con 0x7f31c015ef80 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.943+0000 7f31c609d640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c015ef80 0x7f31c015f3b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31c0068640 tx=0x7f31b002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1b23a1ed4498 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c489a640 1 -- 172.21.15.18:0/594681033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b002c9e0 con 0x7f31c015ef80 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c489a640 1 -- 172.21.15.18:0/594681033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b002cb80 con 0x7f31c015ef80 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c489a640 1 -- 172.21.15.18:0/594681033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b00343f0 con 0x7f31c015ef80 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 -- 172.21.15.18:0/594681033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c015ef80 msgr2=0x7f31c015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c015ef80 0x7f31c015f3b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31c0068640 tx=0x7f31b002be40 comp rx=0 tx=0).stop 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 -- 172.21.15.18:0/594681033 shutdown_connections 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c015ef80 0x7f31c015f3b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 --2- 172.21.15.18:0/594681033 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c00cb990 0x7f31c00cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 --2- 172.21.15.18:0/594681033 >> v2:172.21.15.104:3300/0 conn(0x7f31c015c5a0 0x7f31c0163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 -- 172.21.15.18:0/594681033 >> 172.21.15.18:0/594681033 conn(0x7f31c00d2640 msgr2=0x7f31c00d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 -- 172.21.15.18:0/594681033 shutdown_connections 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.944+0000 7f31c7b00640 1 -- 172.21.15.18:0/594681033 wait complete. 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.945+0000 7f31c7b00640 1 Processor -- start 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.945+0000 7f31c7b00640 1 -- start start 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c015c5a0 0x7f31c00b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c015ef80 0x7f31c01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31c0162650 con 0x7f31c00cb990 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f31c015fba0 con 0x7f31c015ef80 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c7b00640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f31c0162930 con 0x7f31c015c5a0 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34124/0 (socket says 172.21.15.18:34124) 2024-04-16T12:56:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 -- 172.21.15.18:0/2071818524 learned_addr learned my addr 172.21.15.18:0/2071818524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c509b640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c015c5a0 0x7f31c00b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c609d640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c015ef80 0x7f31c01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 -- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c015c5a0 msgr2=0x7f31c00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c015c5a0 0x7f31c00b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 -- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c015ef80 msgr2=0x7f31c01f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c015ef80 0x7f31c01f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.946+0000 7f31c589c640 1 -- 172.21.15.18:0/2071818524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c00a9510 con 0x7f31c00cb990 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31c589c640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f31b800d830 tx=0x7f31b800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b800b6c0 con 0x7f31c00cb990 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8019070 con 0x7f31c00cb990 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c00a97b0 con 0x7f31c00cb990 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b800ba80 con 0x7f31c00cb990 2024-04-16T12:56:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.947+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c00a9d70 con 0x7f31c00cb990 2024-04-16T12:56:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.948+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c00752b0 con 0x7f31c00cb990 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.948+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31b801e460 con 0x7f31c00cb990 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.949+0000 7f31be7fc640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 0x7f31ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.949+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f31b808bfd0 con 0x7f31c00cb990 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.949+0000 7f31c509b640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 0x7f31ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.949+0000 7f31c509b640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 0x7f31ac06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31c01f2100 tx=0x7f31b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:17.953+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31b805a5c0 con 0x7f31c00cb990 2024-04-16T12:56:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.209+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f31c00cc930 con 0x7f31c00cb990 2024-04-16T12:56:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.211+0000 7f31be7fc640 1 -- 172.21.15.18:0/2071818524 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f31b8059ec0 con 0x7f31c00cb990 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 msgr2=0x7f31ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 0x7f31ac06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31c01f2100 tx=0x7f31b4008040 comp rx=0 tx=0).stop 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 msgr2=0x7f31c00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f31b800d830 tx=0x7f31b800dcf0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 shutdown_connections 2024-04-16T12:56:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f31ac06c8f0 0x7f31ac06edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c015ef80 0x7f31c01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f31c015c5a0 0x7f31c00b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 --2- 172.21.15.18:0/2071818524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c00cb990 0x7f31c00aa570 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 >> 172.21.15.18:0/2071818524 conn(0x7f31c00d2640 msgr2=0x7f31c00cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 shutdown_connections 2024-04-16T12:56:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.213+0000 7f31c7b00640 1 -- 172.21.15.18:0/2071818524 wait complete. 2024-04-16T12:56:18.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T12:56:18.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.330+0000 7fc51bfd5640 1 Processor -- start 2024-04-16T12:56:18.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.331+0000 7fc51bfd5640 1 -- start start 2024-04-16T12:56:18.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51bfd5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51bfd5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc51415ef80 0x7fc51415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51bfd5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51415c980 con 0x7fc51415c5a0 2024-04-16T12:56:18.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51bfd5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc51415f910 con 0x7fc51415ef80 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51bfd5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc514072180 con 0x7fc5140cc0a0 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc51a572640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc51415ef80 0x7fc51415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:57434/0 (socket says 172.21.15.18:57434) 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 -- 172.21.15.18:0/2726330660 learned_addr learned my addr 172.21.15.18:0/2726330660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519d71640 1 --1- 172.21.15.18:0/2726330660 >> v1:172.21.15.104:6789/0 conn(0x7fc51415c5a0 0x7fc5140cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:45678/0 (socket says 172.21.15.18:45678) 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 -- 172.21.15.18:0/2726330660 >> v2:172.21.15.104:3300/0 conn(0x7fc51415ef80 msgr2=0x7fc51415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 --2- 172.21.15.18:0/2726330660 >> v2:172.21.15.104:3300/0 conn(0x7fc51415ef80 0x7fc51415f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 -- 172.21.15.18:0/2726330660 >> v1:172.21.15.104:6789/0 conn(0x7fc51415c5a0 legacy=0x7fc5140cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.332+0000 7fc519570640 1 -- 172.21.15.18:0/2726330660 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51415fe80 con 0x7fc5140cc0a0 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.333+0000 7fc519570640 1 --2- 172.21.15.18:0/2726330660 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc508009870 tx=0x7fc50802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f71bf774c02584 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.333+0000 7fc518d6f640 1 -- 172.21.15.18:0/2726330660 <== mon.2 v2:172.21.15.104:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508035020 con 0x7fc5140cc0a0 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.333+0000 7fc518d6f640 1 -- 172.21.15.18:0/2726330660 <== mon.2 v2:172.21.15.104:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc508031640 con 0x7fc5140cc0a0 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.333+0000 7fc518d6f640 1 -- 172.21.15.18:0/2726330660 <== mon.2 v2:172.21.15.104:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50802d040 con 0x7fc5140cc0a0 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 -- 172.21.15.18:0/2726330660 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 msgr2=0x7fc514163130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/2726330660 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc508009870 tx=0x7fc50802b8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 -- 172.21.15.18:0/2726330660 shutdown_connections 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/2726330660 >> v2:172.21.15.104:3300/0 conn(0x7fc51415ef80 0x7fc51415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/2726330660 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc514163130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 -- 172.21.15.18:0/2726330660 >> 172.21.15.18:0/2726330660 conn(0x7fc5140d2640 msgr2=0x7fc5140d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 -- 172.21.15.18:0/2726330660 shutdown_connections 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.334+0000 7fc51bfd5640 1 -- 172.21.15.18:0/2726330660 wait complete. 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.335+0000 7fc51bfd5640 1 Processor -- start 2024-04-16T12:56:18.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.335+0000 7fc51bfd5640 1 -- start start 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc5140b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc51415c5a0 0x7fc514151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc514162930 con 0x7fc51415ef80 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc514162650 con 0x7fc51415c5a0 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51bfd5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fc51406ff60 con 0x7fc5140cc0a0 2024-04-16T12:56:18.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34130/0 (socket says 172.21.15.18:34130) 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 -- 172.21.15.18:0/3730342952 learned_addr learned my addr 172.21.15.18:0/3730342952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc519d71640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc5140b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc519570640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc51415c5a0 0x7fc514151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 -- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 msgr2=0x7fc5140b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc5140b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 -- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc51415c5a0 msgr2=0x7fc514151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc51415c5a0 0x7fc514151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 -- 172.21.15.18:0/3730342952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc514151560 con 0x7fc51415ef80 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc519d71640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc5140b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc51a572640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc50400efc0 tx=0x7fc50400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504018020 con 0x7fc51415ef80 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.336+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504014480 con 0x7fc51415ef80 2024-04-16T12:56:18.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.337+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504014870 con 0x7fc51415ef80 2024-04-16T12:56:18.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.337+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5140b7120 con 0x7fc51415ef80 2024-04-16T12:56:18.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.337+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5140b76e0 con 0x7fc51415ef80 2024-04-16T12:56:18.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.337+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5140752b0 con 0x7fc51415ef80 2024-04-16T12:56:18.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.338+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc504005d10 con 0x7fc51415ef80 2024-04-16T12:56:18.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.339+0000 7fc5127fc640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.339+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fc50408c520 con 0x7fc51415ef80 2024-04-16T12:56:18.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.339+0000 7fc519d71640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.339+0000 7fc519d71640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 0x7fc50006edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc50c000f60 tx=0x7fc50c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.343+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc504022070 con 0x7fc51415ef80 2024-04-16T12:56:18.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.603+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fc5140d30f0 con 0x7fc51415ef80 2024-04-16T12:56:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.605+0000 7fc5127fc640 1 -- 172.21.15.18:0/3730342952 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v12) ==== 97+0+0 (secure 0 0 0) 0x7fc504010040 con 0x7fc51415ef80 2024-04-16T12:56:18.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 msgr2=0x7fc50006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 0x7fc50006edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc50c000f60 tx=0x7fc50c009040 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 msgr2=0x7fc5140b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc50400efc0 tx=0x7fc50400c490 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 shutdown_connections 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc51415ef80 0x7fc5140b6740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc51415c5a0 0x7fc514151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 --2- 172.21.15.18:0/3730342952 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fc5140cc0a0 0x7fc5140b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 >> 172.21.15.18:0/3730342952 conn(0x7fc5140d2640 msgr2=0x7fc5140ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 shutdown_connections 2024-04-16T12:56:18.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.607+0000 7fc51bfd5640 1 -- 172.21.15.18:0/3730342952 wait complete. 2024-04-16T12:56:18.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.723+0000 7f15b7a55640 1 Processor -- start 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.723+0000 7f15b7a55640 1 -- start start 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b7a55640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f15b006ce10 0x7f15b006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b7a55640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b00cffe0 con 0x7f15b00d3150 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b7a55640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b015f0a0 con 0x7f15b00d2ce0 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b7a55640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f15b00d37a0 con 0x7f15b006ce10 2024-04-16T12:56:18.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b57f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f15b006ce10 0x7f15b006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b5ff2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f15b00d3150 0x7f15b00cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38702/0 (socket says 172.21.15.18:38702) 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.724+0000 7f15b5ff2640 1 -- 172.21.15.18:0/3169574525 learned_addr learned my addr 172.21.15.18:0/3169574525 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.725+0000 7f15b57f1640 1 -- 172.21.15.18:0/3169574525 >> v1:172.21.15.104:6789/0 conn(0x7f15b00d2ce0 legacy=0x7f15b00cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.725+0000 7f15b57f1640 1 -- 172.21.15.18:0/3169574525 >> v1:172.21.15.18:6789/0 conn(0x7f15b00d3150 legacy=0x7f15b00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.725+0000 7f15b57f1640 1 -- 172.21.15.18:0/3169574525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b00d3a80 con 0x7f15b006ce10 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.725+0000 7f15affff640 1 -- 172.21.15.18:0/3169574525 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417354635 0 0) 0x7f15b00cffe0 con 0x7f15b00d3150 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.725+0000 7f15b57f1640 1 --2- 172.21.15.18:0/3169574525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b006d1f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009d90 tx=0x7f15a002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb2b06c91f03b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15affff640 1 -- 172.21.15.18:0/3169574525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0039070 con 0x7f15b006ce10 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15affff640 1 -- 172.21.15.18:0/3169574525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a002cd80 con 0x7f15b006ce10 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15affff640 1 -- 172.21.15.18:0/3169574525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0034660 con 0x7f15b006ce10 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 -- 172.21.15.18:0/3169574525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 msgr2=0x7f15b006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3169574525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b006d1f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009d90 tx=0x7f15a002bfd0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 -- 172.21.15.18:0/3169574525 shutdown_connections 2024-04-16T12:56:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3169574525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b006d1f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 -- 172.21.15.18:0/3169574525 >> 172.21.15.18:0/3169574525 conn(0x7f15b00d48d0 msgr2=0x7f15b00d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 -- 172.21.15.18:0/3169574525 shutdown_connections 2024-04-16T12:56:18.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.726+0000 7f15b7a55640 1 -- 172.21.15.18:0/3169574525 wait complete. 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.727+0000 7f15b7a55640 1 Processor -- start 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 -- start start 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15b00d2ce0 0x7f15b015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15b00d3150 0x7f15b0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00d4320 con 0x7f15b006ce10 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00d4040 con 0x7f15b00d2ce0 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b7a55640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f15b006d730 con 0x7f15b00d3150 2024-04-16T12:56:18.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b57f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b57f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34156/0 (socket says 172.21.15.18:34156) 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.728+0000 7f15b57f1640 1 -- 172.21.15.18:0/3447398210 learned_addr learned my addr 172.21.15.18:0/3447398210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 -- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15b00d3150 msgr2=0x7f15b0143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15b00d3150 0x7f15b0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 -- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15b00d2ce0 msgr2=0x7f15b015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15b00d2ce0 0x7f15b015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 -- 172.21.15.18:0/3447398210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b0141bf0 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b57f1640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009d90 tx=0x7f15a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0039050 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a0045070 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b00c9c50 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a003ea50 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.729+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b0142190 con 0x7f15b006ce10 2024-04-16T12:56:18.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.730+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b00752b0 con 0x7f15b006ce10 2024-04-16T12:56:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.731+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15a002cc40 con 0x7f15b006ce10 2024-04-16T12:56:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.731+0000 7f15adffb640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.731+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f15a00ae890 con 0x7f15b006ce10 2024-04-16T12:56:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.732+0000 7f15b4ff0640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:18.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.732+0000 7f15b4ff0640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15a4000f60 tx=0x7f15a40079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:18.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.736+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15a007cdf0 con 0x7f15b006ce10 2024-04-16T12:56:18.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.992+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f15b015e620 con 0x7f15b006ce10 2024-04-16T12:56:18.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.994+0000 7f15adffb640 1 -- 172.21.15.18:0/3447398210 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v13) ==== 90+0+0 (secure 0 0 0) 0x7f15a007c6f0 con 0x7f15b006ce10 2024-04-16T12:56:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 msgr2=0x7f159c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15a4000f60 tx=0x7f15a40079b0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 msgr2=0x7f15b0159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:18.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009d90 tx=0x7f15a0004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 shutdown_connections 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f15b00d3150 0x7f15b0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15b00d2ce0 0x7f15b015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 --2- 172.21.15.18:0/3447398210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b006ce10 0x7f15b0159bd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 >> 172.21.15.18:0/3447398210 conn(0x7f15b00d48d0 msgr2=0x7f15b00b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 shutdown_connections 2024-04-16T12:56:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:18.996+0000 7f15b7a55640 1 -- 172.21.15.18:0/3447398210 wait complete. 2024-04-16T12:56:19.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.112+0000 7f3784bf4640 1 Processor -- start 2024-04-16T12:56:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.112+0000 7f3784bf4640 1 -- start start 2024-04-16T12:56:19.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f3784bf4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3780162240 0x7f37800b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f3784bf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006c130 0x7f378006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f3784bf4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378006c6c0 con 0x7f378006ce10 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f3784bf4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f378006d7b0 con 0x7f3780162240 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f3784bf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f378006c9a0 con 0x7f378006c130 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3780162240 0x7f37800b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3780162240 0x7f37800b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34166/0 (socket says 172.21.15.18:34166) 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377dd9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f378006ce10 0x7f378006ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38710/0 (socket says 172.21.15.18:38710) 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 -- 172.21.15.18:0/1333130495 learned_addr learned my addr 172.21.15.18:0/1333130495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377ed9d640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006c130 0x7f378006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 -- 172.21.15.18:0/1333130495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006c130 msgr2=0x7f378006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006c130 0x7f378006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 -- 172.21.15.18:0/1333130495 >> v1:172.21.15.18:6789/0 conn(0x7f378006ce10 legacy=0x7f378006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377e59c640 1 -- 172.21.15.18:0/1333130495 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37800d2db0 con 0x7f3780162240 2024-04-16T12:56:19.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.113+0000 7f377d59a640 1 -- 172.21.15.18:0/1333130495 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768161919 0 0) 0x7f378006c6c0 con 0x7f378006ce10 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f377e59c640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3780162240 0x7f37800b7b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3778009e50 tx=0x7f377802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7c2402ae515548 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f377d59a640 1 -- 172.21.15.18:0/1333130495 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377802ca70 con 0x7f3780162240 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f377d59a640 1 -- 172.21.15.18:0/1333130495 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377802cc10 con 0x7f3780162240 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f377d59a640 1 -- 172.21.15.18:0/1333130495 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780343f0 con 0x7f3780162240 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f3784bf4640 1 -- 172.21.15.18:0/1333130495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3780162240 msgr2=0x7f37800b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.114+0000 7f3784bf4640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3780162240 0x7f37800b7b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3778009e50 tx=0x7f377802bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 -- 172.21.15.18:0/1333130495 shutdown_connections 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006c130 0x7f378006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 --2- 172.21.15.18:0/1333130495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3780162240 0x7f37800b7b00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 -- 172.21.15.18:0/1333130495 >> 172.21.15.18:0/1333130495 conn(0x7f37800d48b0 msgr2=0x7f37800d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 -- 172.21.15.18:0/1333130495 shutdown_connections 2024-04-16T12:56:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.115+0000 7f3784bf4640 1 -- 172.21.15.18:0/1333130495 wait complete. 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.116+0000 7f3784bf4640 1 Processor -- start 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.116+0000 7f3784bf4640 1 -- start start 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 0x7f37800cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 0x7f37800c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37800d3a10 con 0x7f378006c130 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37800d3890 con 0x7f3780162240 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f37800d3b90 con 0x7f378006ce10 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34170/0 (socket says 172.21.15.18:34170) 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 -- 172.21.15.18:0/2009364313 learned_addr learned my addr 172.21.15.18:0/2009364313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377dd9b640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 0x7f37800cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377ed9d640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 0x7f37800c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 -- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 msgr2=0x7f37800cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 0x7f37800cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 -- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 msgr2=0x7f37800c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 0x7f37800c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 -- 172.21.15.18:0/2009364313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780144d70 con 0x7f378006c130 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377dd9b640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 0x7f37800cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377ed9d640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 0x7f37800c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f377e59c640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3778036040 tx=0x7f3778004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778043020 con 0x7f378006c130 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377803e450 con 0x7f378006c130 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778009510 con 0x7f378006c130 2024-04-16T12:56:19.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3780145050 con 0x7f378006c130 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.117+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3780145610 con 0x7f378006c130 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.118+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37800752b0 con 0x7f378006c130 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.119+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3778046020 con 0x7f378006c130 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.119+0000 7f3776ffd640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 0x7f376006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.119+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f37780ae1f0 con 0x7f378006c130 2024-04-16T12:56:19.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.119+0000 7f377dd9b640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 0x7f376006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.120+0000 7f377dd9b640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 0x7f376006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37800d5170 tx=0x7f3768009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.124+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f377804d030 con 0x7f378006c130 2024-04-16T12:56:19.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.310+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37800b52c0 con 0x7f378006c130 2024-04-16T12:56:19.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.310+0000 7f3776ffd640 1 -- 172.21.15.18:0/2009364313 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13164 (secure 0 0 0) 0x7f377807c760 con 0x7f378006c130 2024-04-16T12:56:19.312 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:19.312 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":34,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:56:16.212455+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:19.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 msgr2=0x7f376006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 0x7f376006ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37800d5170 tx=0x7f3768009040 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 msgr2=0x7f37800b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3778036040 tx=0x7f3778004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 shutdown_connections 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f376006c920 0x7f376006ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3780162240 0x7f37800c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f378006ce10 0x7f37800cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 --2- 172.21.15.18:0/2009364313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f378006c130 0x7f37800b37b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 >> 172.21.15.18:0/2009364313 conn(0x7f37800d48b0 msgr2=0x7f37800d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 shutdown_connections 2024-04-16T12:56:19.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.312+0000 7f3784bf4640 1 -- 172.21.15.18:0/2009364313 wait complete. 2024-04-16T12:56:19.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T12:54:54.532924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T12:56:19.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T12:56:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.432+0000 7ff52484a640 1 Processor -- start 2024-04-16T12:56:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.432+0000 7ff52484a640 1 -- start start 2024-04-16T12:56:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff52484a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff5200b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff52484a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff52006ca30 0x7ff52006ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff52484a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52015ece0 con 0x7ff5200b4080 2024-04-16T12:56:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff52484a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff5200b4570 con 0x7ff52006ca30 2024-04-16T12:56:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff52484a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff5200b4850 con 0x7ff52015e900 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff52006ca30 0x7ff52006ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff52006ca30 0x7ff52006ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34178/0 (socket says 172.21.15.18:34178) 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 -- 172.21.15.18:0/2874676098 learned_addr learned my addr 172.21.15.18:0/2874676098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51e59c640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff5200b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 -- 172.21.15.18:0/2874676098 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 msgr2=0x7ff5200b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff5200b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 -- 172.21.15.18:0/2874676098 >> v1:172.21.15.104:6789/0 conn(0x7ff5200b4080 legacy=0x7ff52006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51ed9d640 1 -- 172.21.15.18:0/2874676098 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5200b4b30 con 0x7ff52006ca30 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.433+0000 7ff51e59c640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff5200b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.434+0000 7ff51ed9d640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff52006ceb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff518009e50 tx=0x7ff51802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3ef0c13d64fe23 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.434+0000 7ff51dd9b640 1 -- 172.21.15.18:0/2874676098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51802ca70 con 0x7ff52006ca30 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.434+0000 7ff51dd9b640 1 -- 172.21.15.18:0/2874676098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51802cc10 con 0x7ff52006ca30 2024-04-16T12:56:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.434+0000 7ff51dd9b640 1 -- 172.21.15.18:0/2874676098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180343f0 con 0x7ff52006ca30 2024-04-16T12:56:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 -- 172.21.15.18:0/2874676098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 msgr2=0x7ff52006ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff52006ceb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff518009e50 tx=0x7ff51802bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 -- 172.21.15.18:0/2874676098 shutdown_connections 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff52006ceb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 --2- 172.21.15.18:0/2874676098 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff5200b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 -- 172.21.15.18:0/2874676098 >> 172.21.15.18:0/2874676098 conn(0x7ff520072380 msgr2=0x7ff520072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 -- 172.21.15.18:0/2874676098 shutdown_connections 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.435+0000 7ff52484a640 1 -- 172.21.15.18:0/2874676098 wait complete. 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.436+0000 7ff52484a640 1 Processor -- start 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.436+0000 7ff52484a640 1 -- start start 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5200b4080 0x7ff520144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff520153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff52006f570 con 0x7ff52006ca30 2024-04-16T12:56:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff52006e940 con 0x7ff5200b4080 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff52484a640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff52006f6f0 con 0x7ff52015e900 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34188/0 (socket says 172.21.15.18:34188) 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 -- 172.21.15.18:0/2080557205 learned_addr learned my addr 172.21.15.18:0/2080557205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 -- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 msgr2=0x7ff520153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff520153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 -- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5200b4080 msgr2=0x7ff520144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5200b4080 0x7ff520144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 -- 172.21.15.18:0/2080557205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff520152a90 con 0x7ff52006ca30 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff51e59c640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff51000c820 tx=0x7ff51000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510015070 con 0x7ff52006ca30 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.437+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510007a30 con 0x7ff52006ca30 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.438+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff520152d70 con 0x7ff52006ca30 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.438+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510007de0 con 0x7ff52006ca30 2024-04-16T12:56:19.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.438+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff520153330 con 0x7ff52006ca30 2024-04-16T12:56:19.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.438+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5200752b0 con 0x7ff52006ca30 2024-04-16T12:56:19.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.439+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff510018070 con 0x7ff52006ca30 2024-04-16T12:56:19.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.439+0000 7ff516ffd640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.439+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff51008b7f0 con 0x7ff52006ca30 2024-04-16T12:56:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.440+0000 7ff517fff640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.440+0000 7ff517fff640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 0x7ff50006edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff520150a10 tx=0x7ff5080079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.444+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff510059e70 con 0x7ff52006ca30 2024-04-16T12:56:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.628+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5200735e0 con 0x7ff52006ca30 2024-04-16T12:56:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.628+0000 7ff516ffd640 1 -- 172.21.15.18:0/2080557205 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7ff510059770 con 0x7ff52006ca30 2024-04-16T12:56:19.630 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-16T12:56:19.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 msgr2=0x7ff50006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 0x7ff50006edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff520150a10 tx=0x7ff5080079b0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 msgr2=0x7ff5201442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff51000c820 tx=0x7ff51000cce0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 shutdown_connections 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff50006c8f0 0x7ff50006edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff52015e900 0x7ff520153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5200b4080 0x7ff520144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 --2- 172.21.15.18:0/2080557205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52006ca30 0x7ff5201442b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 >> 172.21.15.18:0/2080557205 conn(0x7ff520072380 msgr2=0x7ff5200b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 shutdown_connections 2024-04-16T12:56:19.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.630+0000 7ff52484a640 1 -- 172.21.15.18:0/2080557205 wait complete. 2024-04-16T12:56:19.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T12:56:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.746+0000 7fd3af704640 1 Processor -- start 2024-04-16T12:56:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.746+0000 7fd3af704640 1 -- start start 2024-04-16T12:56:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3af704640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3a80b5be0 0x7fd3a80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3af704640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a806f210 con 0x7fd3a81484d0 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3af704640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a806f480 con 0x7fd3a806e720 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3af704640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a80b0110 con 0x7fd3a80b5be0 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3acc9f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3a80b5be0 0x7fd3a80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3ad4a0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd3a81484d0 0x7fd3a80b54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38712/0 (socket says 172.21.15.18:38712) 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3ad4a0640 1 -- 172.21.15.18:0/751030625 learned_addr learned my addr 172.21.15.18:0/751030625 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3acc9f640 1 -- 172.21.15.18:0/751030625 >> v1:172.21.15.104:6789/0 conn(0x7fd3a806e720 legacy=0x7fd3a806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3acc9f640 1 -- 172.21.15.18:0/751030625 >> v1:172.21.15.18:6789/0 conn(0x7fd3a81484d0 legacy=0x7fd3a80b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3a7fff640 1 -- 172.21.15.18:0/751030625 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008467789 0 0) 0x7fd3a806f210 con 0x7fd3a81484d0 2024-04-16T12:56:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.747+0000 7fd3acc9f640 1 -- 172.21.15.18:0/751030625 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80af0f0 con 0x7fd3a80b5be0 2024-04-16T12:56:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.748+0000 7fd3acc9f640 1 --2- 172.21.15.18:0/751030625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a80b5be0 0x7fd3a80afbd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0097a0 tx=0x7fd39c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7523fb814645c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.748+0000 7fd3a7fff640 1 -- 172.21.15.18:0/751030625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c035020 con 0x7fd3a80b5be0 2024-04-16T12:56:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.748+0000 7fd3a7fff640 1 -- 172.21.15.18:0/751030625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c031830 con 0x7fd3a80b5be0 2024-04-16T12:56:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.748+0000 7fd3a7fff640 1 -- 172.21.15.18:0/751030625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c031c00 con 0x7fd3a80b5be0 2024-04-16T12:56:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 -- 172.21.15.18:0/751030625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a80b5be0 msgr2=0x7fd3a80afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 --2- 172.21.15.18:0/751030625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a80b5be0 0x7fd3a80afbd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0097a0 tx=0x7fd39c02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 -- 172.21.15.18:0/751030625 shutdown_connections 2024-04-16T12:56:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 --2- 172.21.15.18:0/751030625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a80b5be0 0x7fd3a80afbd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 -- 172.21.15.18:0/751030625 >> 172.21.15.18:0/751030625 conn(0x7fd3a80b2990 msgr2=0x7fd3a80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 -- 172.21.15.18:0/751030625 shutdown_connections 2024-04-16T12:56:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.749+0000 7fd3af704640 1 -- 172.21.15.18:0/751030625 wait complete. 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.750+0000 7fd3af704640 1 Processor -- start 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.750+0000 7fd3af704640 1 -- start start 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a806e720 0x7fd3a81416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 0x7fd3a813f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80aed10 con 0x7fd3a81484d0 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80af6b0 con 0x7fd3a80b5be0 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3af704640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a80aee90 con 0x7fd3a806e720 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34208/0 (socket says 172.21.15.18:34208) 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 -- 172.21.15.18:0/1724402896 learned_addr learned my addr 172.21.15.18:0/1724402896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3ad4a0640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a806e720 0x7fd3a81416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3acc9f640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 0x7fd3a813f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 -- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a806e720 msgr2=0x7fd3a81416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a806e720 0x7fd3a81416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 -- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 msgr2=0x7fd3a813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 0x7fd3a813f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3adca1640 1 -- 172.21.15.18:0/1724402896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a815cd10 con 0x7fd3a81484d0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.751+0000 7fd3acc9f640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 0x7fd3a813f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3adca1640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c780 tx=0x7fd39800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398004b60 con 0x7fd3a81484d0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd398004d00 con 0x7fd3a81484d0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39800aa90 con 0x7fd3a81484d0 2024-04-16T12:56:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a8141d20 con 0x7fd3a81484d0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.752+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a815cfd0 con 0x7fd3a81484d0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.753+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a80752b0 con 0x7fd3a81484d0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.753+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd39800ac30 con 0x7fd3a81484d0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.754+0000 7fd3a5ffb640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 0x7fd39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.754+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fd39808bc40 con 0x7fd3a81484d0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.754+0000 7fd3ad4a0640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 0x7fd39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.755+0000 7fd3ad4a0640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 0x7fd39406edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0000f60 tx=0x7fd3a0007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.758+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd398020070 con 0x7fd3a81484d0 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.944+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3a813f6c0 con 0x7fd3a81484d0 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.945+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/1724402896 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fd39805a220 con 0x7fd3a81484d0 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-16T12:56:19.946 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-16T12:56:19.947 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-16T12:56:19.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-16T12:56:19.947 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-16T12:56:19.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 msgr2=0x7fd39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 0x7fd39406edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0000f60 tx=0x7fd3a0007c00 comp rx=0 tx=0).stop 2024-04-16T12:56:19.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 msgr2=0x7fd3a81f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:19.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c780 tx=0x7fd39800cc40 comp rx=0 tx=0).stop 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 shutdown_connections 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fd39406c8f0 0x7fd39406edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a81484d0 0x7fd3a81f6860 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3a80b5be0 0x7fd3a813f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 --2- 172.21.15.18:0/1724402896 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fd3a806e720 0x7fd3a81416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 >> 172.21.15.18:0/1724402896 conn(0x7fd3a80b2990 msgr2=0x7fd3a80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 shutdown_connections 2024-04-16T12:56:19.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:19.947+0000 7fd3af704640 1 -- 172.21.15.18:0/1724402896 wait complete. 2024-04-16T12:56:19.962 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T12:56:19.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T12:56:20.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.069+0000 7fbad0cc1640 1 Processor -- start 2024-04-16T12:56:20.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.069+0000 7fbad0cc1640 1 -- start start 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbad0cc1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc162540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbad0cc1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc162a80 0x7fbacc0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbad0cc1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc162f20 con 0x7fbacc15f6d0 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbad0cc1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbacc144540 con 0x7fbacc162a80 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbad0cc1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fbacc163200 con 0x7fbacc15fab0 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbacad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc162a80 0x7fbacc0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbaca59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbacc15f6d0 0x7fbacc1449d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38714/0 (socket says 172.21.15.18:38714) 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.070+0000 7fbaca59c640 1 -- 172.21.15.18:0/4098742326 learned_addr learned my addr 172.21.15.18:0/4098742326 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:20.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbac9d9b640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbac959a640 1 -- 172.21.15.18:0/4098742326 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522428390 0 0) 0x7fbacc162f20 con 0x7fbacc15f6d0 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbac959a640 1 -- 172.21.15.18:0/4098742326 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbab8003520 con 0x7fbacc15f6d0 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbacad9d640 1 -- 172.21.15.18:0/4098742326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 msgr2=0x7fbacc162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbacad9d640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc162540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbacad9d640 1 -- 172.21.15.18:0/4098742326 >> v1:172.21.15.18:6789/0 conn(0x7fbacc15f6d0 legacy=0x7fbacc1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.071+0000 7fbacad9d640 1 -- 172.21.15.18:0/4098742326 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc1441d0 con 0x7fbacc162a80 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbacad9d640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0ae5b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0097a0 tx=0x7fbabc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fa61074244dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbac959a640 1 -- 172.21.15.18:0/4098742326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc035020 con 0x7fbacc162a80 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbac959a640 1 -- 172.21.15.18:0/4098742326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc031830 con 0x7fbacc162a80 2024-04-16T12:56:20.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbac959a640 1 -- 172.21.15.18:0/4098742326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc031c00 con 0x7fbacc162a80 2024-04-16T12:56:20.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 -- 172.21.15.18:0/4098742326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 msgr2=0x7fbacc0ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:20.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0ae5b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0097a0 tx=0x7fbabc02b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 -- 172.21.15.18:0/4098742326 shutdown_connections 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0ae5b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/4098742326 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc162540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 -- 172.21.15.18:0/4098742326 >> 172.21.15.18:0/4098742326 conn(0x7fbacc0b6af0 msgr2=0x7fbacc0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 -- 172.21.15.18:0/4098742326 shutdown_connections 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.072+0000 7fbad0cc1640 1 -- 172.21.15.18:0/4098742326 wait complete. 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 Processor -- start 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 -- start start 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbacc15f6d0 0x7fbacc0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc0aeaf0 con 0x7fbacc162a80 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc15f320 con 0x7fbacc15f6d0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.074+0000 7fbad0cc1640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fbacc0aec70 con 0x7fbacc15fab0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34224/0 (socket says 172.21.15.18:34224) 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 -- 172.21.15.18:0/1116672976 learned_addr learned my addr 172.21.15.18:0/1116672976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbac9d9b640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbaca59c640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbacc15f6d0 0x7fbacc0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 -- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 msgr2=0x7fbacc161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 -- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbacc15f6d0 msgr2=0x7fbacc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbacc15f6d0 0x7fbacc0ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 -- 172.21.15.18:0/1116672976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc14ea30 con 0x7fbacc162a80 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbacad9d640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbabc02bee0 tx=0x7fbabc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:20.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc035040 con 0x7fbacc162a80 2024-04-16T12:56:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc03f070 con 0x7fbacc162a80 2024-04-16T12:56:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc03ba80 con 0x7fbacc162a80 2024-04-16T12:56:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc14e750 con 0x7fbacc162a80 2024-04-16T12:56:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.075+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc0ce520 con 0x7fbacc162a80 2024-04-16T12:56:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.076+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc068a70 con 0x7fbacc162a80 2024-04-16T12:56:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.077+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbabc038020 con 0x7fbacc162a80 2024-04-16T12:56:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.077+0000 7fbac2ffd640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 0x7fbaac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.077+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fbabc0ad780 con 0x7fbacc162a80 2024-04-16T12:56:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.077+0000 7fbaca59c640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 0x7fbaac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.078+0000 7fbaca59c640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 0x7fbaac06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005c00 tx=0x7fbac4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:20.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.081+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbabc031800 con 0x7fbacc162a80 2024-04-16T12:56:20.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:20.268+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbacc0ae6e0 con 0x7fbacc162a80 2024-04-16T12:56:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.221+0000 7fbac2ffd640 1 -- 172.21.15.18:0/1116672976 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7fbabc07b720 con 0x7fbacc162a80 2024-04-16T12:56:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 msgr2=0x7fbaac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 0x7fbaac06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005c00 tx=0x7fbac4009040 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 msgr2=0x7fbacc0cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbabc02bee0 tx=0x7fbabc0046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 shutdown_connections 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fbaac06c8f0 0x7fbaac06edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc162a80 0x7fbacc0cbbc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fbacc15fab0 0x7fbacc161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 --2- 172.21.15.18:0/1116672976 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbacc15f6d0 0x7fbacc0ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.224+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 >> 172.21.15.18:0/1116672976 conn(0x7fbacc0b6af0 msgr2=0x7fbacc15d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.225+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 shutdown_connections 2024-04-16T12:56:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.225+0000 7fbad0cc1640 1 -- 172.21.15.18:0/1116672976 wait complete. 2024-04-16T12:56:21.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T12:56:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.355+0000 7f6f80f75640 1 Processor -- start 2024-04-16T12:56:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.355+0000 7f6f80f75640 1 -- start start 2024-04-16T12:56:21.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f80f75640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f7c0d3150 0x7f6f7c0b8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f80f75640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c15f0a0 con 0x7f6f7c06ce10 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f80f75640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c0d37a0 con 0x7f6f7c0d2ce0 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f80f75640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7c0d3a80 con 0x7f6f7c0d3150 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f7c0d3150 0x7f6f7c0b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6f7c06ce10 0x7f6f7c06d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38724/0 (socket says 172.21.15.18:38724) 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7a59c640 1 -- 172.21.15.18:0/1030445624 learned_addr learned my addr 172.21.15.18:0/1030445624 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7ad9d640 1 -- 172.21.15.18:0/1030445624 >> v1:172.21.15.104:6789/0 conn(0x7f6f7c0d2ce0 legacy=0x7f6f7c0b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7ad9d640 1 -- 172.21.15.18:0/1030445624 >> v1:172.21.15.18:6789/0 conn(0x7f6f7c06ce10 legacy=0x7f6f7c06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f79d9b640 1 -- 172.21.15.18:0/1030445624 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531491026 0 0) 0x7f6f7c15f0a0 con 0x7f6f7c06ce10 2024-04-16T12:56:21.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.356+0000 7f6f7ad9d640 1 -- 172.21.15.18:0/1030445624 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c0d3d60 con 0x7f6f7c0d3150 2024-04-16T12:56:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f7ad9d640 1 --2- 172.21.15.18:0/1030445624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0b8230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009d90 tx=0x7f6f7402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5019cfaa5cf5d5c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f79d9b640 1 -- 172.21.15.18:0/1030445624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74039070 con 0x7f6f7c0d3150 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f79d9b640 1 -- 172.21.15.18:0/1030445624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7402cd80 con 0x7f6f7c0d3150 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f79d9b640 1 -- 172.21.15.18:0/1030445624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74034660 con 0x7f6f7c0d3150 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f80f75640 1 -- 172.21.15.18:0/1030445624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c0d3150 msgr2=0x7f6f7c0b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.357+0000 7f6f80f75640 1 --2- 172.21.15.18:0/1030445624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0b8230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009d90 tx=0x7f6f7402bfd0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.358+0000 7f6f80f75640 1 -- 172.21.15.18:0/1030445624 shutdown_connections 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.358+0000 7f6f80f75640 1 --2- 172.21.15.18:0/1030445624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0b8230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.358+0000 7f6f80f75640 1 -- 172.21.15.18:0/1030445624 >> 172.21.15.18:0/1030445624 conn(0x7f6f7c0d48d0 msgr2=0x7f6f7c0d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.358+0000 7f6f80f75640 1 -- 172.21.15.18:0/1030445624 shutdown_connections 2024-04-16T12:56:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.358+0000 7f6f80f75640 1 -- 172.21.15.18:0/1030445624 wait complete. 2024-04-16T12:56:21.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.359+0000 7f6f80f75640 1 Processor -- start 2024-04-16T12:56:21.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.359+0000 7f6f80f75640 1 -- start start 2024-04-16T12:56:21.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 0x7f6f7c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c06bc20 con 0x7f6f7c06ce10 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0d4320 con 0x7f6f7c0d3150 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0b8770 con 0x7f6f7c0d2ce0 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34234/0 (socket says 172.21.15.18:34234) 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 -- 172.21.15.18:0/2086015677 learned_addr learned my addr 172.21.15.18:0/2086015677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7ad9d640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f73fff640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 0x7f6f7c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 -- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 msgr2=0x7f6f7c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 0x7f6f7c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 -- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 msgr2=0x7f6f7c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:21.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 -- 172.21.15.18:0/2086015677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c14d230 con 0x7f6f7c06ce10 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7ad9d640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f73fff640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 0x7f6f7c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f7a59c640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c4a0 tx=0x7f6f6c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c018070 con 0x7f6f7c06ce10 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0074e0 con 0x7f6f7c06ce10 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c0cbf80 con 0x7f6f7c06ce10 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.360+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c004a20 con 0x7f6f7c06ce10 2024-04-16T12:56:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.361+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c0cc540 con 0x7f6f7c06ce10 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.362+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7c0752b0 con 0x7f6f7c06ce10 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.362+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f6c01b070 con 0x7f6f7c06ce10 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.363+0000 7f6f72ffd640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 0x7f6f5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.363+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f6f6c08ade0 con 0x7f6f7c06ce10 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.363+0000 7f6f73fff640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 0x7f6f5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.363+0000 7f6f73fff640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 0x7f6f5c06edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0cac30 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:21.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.367+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f7c14d230 con 0x7f6f7c06ce10 2024-04-16T12:56:21.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:21.551+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6f7c06d510 con 0x7f6f7c06ce10 2024-04-16T12:56:22.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.223+0000 7f6f72ffd640 1 -- 172.21.15.18:0/2086015677 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f6f6c059260 con 0x7f6f7c06ce10 2024-04-16T12:56:22.224 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 msgr2=0x7f6f5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 0x7f6f5c06edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0cac30 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 msgr2=0x7f6f7c0cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c4a0 tx=0x7f6f6c00c960 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 shutdown_connections 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f5c06c8f0 0x7f6f5c06edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0d3150 0x7f6f7c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f7c0d2ce0 0x7f6f7c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 --2- 172.21.15.18:0/2086015677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7c06ce10 0x7f6f7c0cb9a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 >> 172.21.15.18:0/2086015677 conn(0x7f6f7c0d48d0 msgr2=0x7f6f7c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.226+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 shutdown_connections 2024-04-16T12:56:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.227+0000 7f6f80f75640 1 -- 172.21.15.18:0/2086015677 wait complete. 2024-04-16T12:56:22.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T12:56:22.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.365+0000 7fe9b0e37640 1 Processor -- start 2024-04-16T12:56:22.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 -- start start 2024-04-16T12:56:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9ac0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe9ac0b6390 0x7fe9ac0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ac15f100 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ac0cf740 con 0x7fe9ac0b6390 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.366+0000 7fe9b0e37640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0cf8e0 con 0x7fe9ac15ed20 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe9ac0b3ec0 0x7fe9ac0d3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38736/0 (socket says 172.21.15.18:38736) 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/1967533631 learned_addr learned my addr 172.21.15.18:0/1967533631 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9ac0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9aad9d640 1 --2- 172.21.15.18:0/1967533631 >> v2:172.21.15.104:3300/0 conn(0x7fe9ac0b6390 0x7fe9ac0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991674124 0 0) 0x7fe9ac15f100 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998003520 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798673412 0 0) 0x7fe998003520 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 msgr2=0x7fe9ac0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9ac0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 >> v2:172.21.15.104:3300/0 conn(0x7fe9ac0b6390 msgr2=0x7fe9ac0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 --2- 172.21.15.18:0/1967533631 >> v2:172.21.15.104:3300/0 conn(0x7fe9ac0b6390 0x7fe9ac0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac0cfb30 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fe994001670 con 0x7fe9ac0b3ec0 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9aad9d640 1 --2- 172.21.15.18:0/1967533631 >> v2:172.21.15.104:3300/0 conn(0x7fe9ac0b6390 0x7fe9ac0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 >> v1:172.21.15.18:6789/0 conn(0x7fe9ac0b3ec0 legacy=0x7fe9ac0d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe998003f30 0x7fe998004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe998004d40 0x7fe9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0cf740 con 0x7fe998003f30 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0cf8e0 con 0x7fe998004d40 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe99800b9c0 con 0x7fe9ac15ed20 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe998003f30 0x7fe998004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.367+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9aad9d640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe998004d40 0x7fe9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 msgr2=0x7fe9980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9ac15ed20 0x7fe9980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe998004d40 msgr2=0x7fe9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe998004d40 0x7fe9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/1967533631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe998003520 con 0x7fe998003f30 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.368+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe998003f30 0x7fe998004800 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe994001050 tx=0x7fe998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3150d6fa9f6109cb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994007d70 con 0x7fe998003f30 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe994030070 con 0x7fe998003f30 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9a959a640 1 -- 172.21.15.18:0/1967533631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99402cd70 con 0x7fe998003f30 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 -- 172.21.15.18:0/1967533631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe998003f30 msgr2=0x7fe998004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/1967533631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe998003f30 0x7fe998004800 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe994001050 tx=0x7fe998005830 comp rx=0 tx=0).stop 2024-04-16T12:56:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9aad9d640 1 -- 172.21.15.18:0/1967533631 reap_dead start 2024-04-16T12:56:22.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 -- 172.21.15.18:0/1967533631 shutdown_connections 2024-04-16T12:56:22.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 -- 172.21.15.18:0/1967533631 >> 172.21.15.18:0/1967533631 conn(0x7fe9ac0d1390 msgr2=0x7fe9ac0d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:22.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 -- 172.21.15.18:0/1967533631 shutdown_connections 2024-04-16T12:56:22.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.369+0000 7fe9b0e37640 1 -- 172.21.15.18:0/1967533631 wait complete. 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 Processor -- start 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 -- start start 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 0x7fe9ac0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 0x7fe9ac1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d38e0 con 0x7fe9ac158010 2024-04-16T12:56:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d3600 con 0x7fe9ac1f4ba0 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9b0e37640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d00f0 con 0x7fe998003f30 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9a9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9a9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34246/0 (socket says 172.21.15.18:34246) 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.371+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/3538380221 learned_addr learned my addr 172.21.15.18:0/3538380221 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9aad9d640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 0x7fe9ac1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 0x7fe9ac0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 msgr2=0x7fe9ac0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 0x7fe9ac0ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 msgr2=0x7fe9ac1f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 0x7fe9ac1f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 -- 172.21.15.18:0/3538380221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac0cea70 con 0x7fe9ac158010 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 0x7fe9ac0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9aad9d640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 0x7fe9ac1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a9d9b640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c300 tx=0x7fe994000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994045070 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe994004bf0 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac160750 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994007d50 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.372+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac160d10 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.373+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac0752b0 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.374+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe994007070 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.374+0000 7fe9a2ffd640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 0x7fe98c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.374+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7fe9940acd40 con 0x7fe9ac158010 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.375+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 0x7fe98c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:22.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.375+0000 7fe9aa59c640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 0x7fe98c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009ae0 tx=0x7fe9a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:22.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.379+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9ac0cea70 con 0x7fe9ac158010 2024-04-16T12:56:22.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:22.603+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe9ac0b7b00 con 0x7fe9ac158010 2024-04-16T12:56:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.246+0000 7fe9a2ffd640 1 -- 172.21.15.18:0/3538380221 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe99407ab60 con 0x7fe9ac158010 2024-04-16T12:56:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 5 and data pool 6 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 msgr2=0x7fe98c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 0x7fe98c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009ae0 tx=0x7fe9a4008040 comp rx=0 tx=0).stop 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 msgr2=0x7fe9ac14ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c300 tx=0x7fe994000fe0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 shutdown_connections 2024-04-16T12:56:23.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe98c06c8f0 0x7fe98c06edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9ac1f4ba0 0x7fe9ac1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ac158010 0x7fe9ac14ee30 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c300 tx=0x7fe994000fe0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 --2- 172.21.15.18:0/3538380221 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe998003f30 0x7fe9ac0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.252+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 >> 172.21.15.18:0/3538380221 conn(0x7fe9ac0d1390 msgr2=0x7fe9ac0d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:23.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.254+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 shutdown_connections 2024-04-16T12:56:23.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.256+0000 7fe9b0e37640 1 -- 172.21.15.18:0/3538380221 wait complete. 2024-04-16T12:56:23.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.383+0000 7f0e06435640 1 Processor -- start 2024-04-16T12:56:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.383+0000 7f0e06435640 1 -- start start 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e06435640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0e00162240 0x7f0e000b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e06435640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0e0006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e06435640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0006c6c0 con 0x7f0e0006ba20 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e06435640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0006d7b0 con 0x7f0e00162240 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e06435640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0006c9a0 con 0x7f0e0006ce10 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e049d2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0e0006ba20 0x7f0e0006bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38738/0 (socket says 172.21.15.18:38738) 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0e049d2640 1 -- 172.21.15.18:0/2800811755 learned_addr learned my addr 172.21.15.18:0/2800811755 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0e0006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2800811755 >> v2:172.21.15.104:3300/0 conn(0x7f0e00162240 0x7f0e000b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328231234 0 0) 0x7f0e0006c6c0 con 0x7f0e0006ba20 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de8003520 con 0x7f0e0006ba20 2024-04-16T12:56:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219931702 0 0) 0x7f0de8003520 con 0x7f0e0006ba20 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 msgr2=0x7f0e0006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0e0006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 >> v2:172.21.15.104:3300/0 conn(0x7f0e00162240 msgr2=0x7f0e000b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 --2- 172.21.15.18:0/2800811755 >> v2:172.21.15.104:3300/0 conn(0x7f0e00162240 0x7f0e000b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e000d2db0 con 0x7f0e0006ba20 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f0df80019f0 con 0x7f0e0006ba20 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 >> v1:172.21.15.18:6789/0 conn(0x7f0e0006ba20 legacy=0x7f0e0006bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0de80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de8003f30 0x7f0de8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0006c9a0 con 0x7f0de8003f30 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0de800b9c0 con 0x7f0de8004d40 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.384+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0de800bb90 con 0x7f0e0006ce10 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de8003f30 0x7f0de8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0de80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0e049d2640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 msgr2=0x7f0de80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0de80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8004d40 msgr2=0x7f0de80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8004d40 0x7f0de80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2800811755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8003520 con 0x7f0de8003f30 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.385+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e0006ce10 0x7f0de80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de8003f30 0x7f0de8004800 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009ac0 tx=0x7f0de8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ebc7a1bf531415 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4039070 con 0x7f0de8003f30 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df402c680 con 0x7f0de8003f30 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0dfeffd640 1 -- 172.21.15.18:0/2800811755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4009690 con 0x7f0de8003f30 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 -- 172.21.15.18:0/2800811755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de8003f30 msgr2=0x7f0de8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 --2- 172.21.15.18:0/2800811755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0de8003f30 0x7f0de8004800 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009ac0 tx=0x7f0de8005830 comp rx=0 tx=0).stop 2024-04-16T12:56:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e049d2640 1 -- 172.21.15.18:0/2800811755 reap_dead start 2024-04-16T12:56:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 -- 172.21.15.18:0/2800811755 shutdown_connections 2024-04-16T12:56:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 -- 172.21.15.18:0/2800811755 >> 172.21.15.18:0/2800811755 conn(0x7f0e000d48b0 msgr2=0x7f0e000d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 -- 172.21.15.18:0/2800811755 shutdown_connections 2024-04-16T12:56:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.386+0000 7f0e06435640 1 -- 172.21.15.18:0/2800811755 wait complete. 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 Processor -- start 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 -- start start 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8003f30 0x7f0e00155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e00159280 0x7f0e0015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0006d3f0 con 0x7f0e0015c2f0 2024-04-16T12:56:23.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0006d270 con 0x7f0de8003f30 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.388+0000 7f0e06435640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0006d570 con 0x7f0e00159280 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34272/0 (socket says 172.21.15.18:34272) 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2599167391 learned_addr learned my addr 172.21.15.18:0/2599167391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8003f30 0x7f0e00155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0e049d2640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e00159280 0x7f0e0015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e00159280 msgr2=0x7f0e0015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e00159280 0x7f0e0015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8003f30 msgr2=0x7f0e00155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8003f30 0x7f0e00155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 -- 172.21.15.18:0/2599167391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0015b570 con 0x7f0e0015c2f0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dff7fe640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0df402c2f0 tx=0x7f0df4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4042020 con 0x7f0e0015c2f0 2024-04-16T12:56:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df403a040 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e001563c0 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4039070 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.389+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0015b810 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.390+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e000752b0 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.391+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0df4045020 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.391+0000 7f0dfcff9640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 0x7f0dec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.391+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f0df40ad260 con 0x7f0e0015c2f0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.392+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 0x7f0dec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.392+0000 7f0dfffff640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 0x7f0dec06ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009de0 tx=0x7f0df0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.396+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0df404c030 con 0x7f0e0015c2f0 2024-04-16T12:56:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.582+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e0006dd30 con 0x7f0e0015c2f0 2024-04-16T12:56:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.583+0000 7f0dfcff9640 1 -- 172.21.15.18:0/2599167391 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7f0df407b530 con 0x7f0e0015c2f0 2024-04-16T12:56:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:23.585 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:56:22.604463+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:56:20.273104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T12:56:21.555572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 msgr2=0x7f0dec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 0x7f0dec06ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009de0 tx=0x7f0df0009190 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 msgr2=0x7f0e00158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0df402c2f0 tx=0x7f0df4004730 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 shutdown_connections 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0dec06c920 0x7f0dec06ede0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0e00159280 0x7f0e0015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e0015c2f0 0x7f0e00158d40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 --2- 172.21.15.18:0/2599167391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0de8003f30 0x7f0e00155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 >> 172.21.15.18:0/2599167391 conn(0x7f0e000d48b0 msgr2=0x7f0e000d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 shutdown_connections 2024-04-16T12:56:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.585+0000 7f0e06435640 1 -- 172.21.15.18:0/2599167391 wait complete. 2024-04-16T12:56:23.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:23.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.701+0000 7f5bd87c8640 1 Processor -- start 2024-04-16T12:56:23.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.701+0000 7f5bd87c8640 1 -- start start 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.702+0000 7f5bd87c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bd0163120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.702+0000 7f5bd87c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5bd00cee60 0x7f5bd00cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.702+0000 7f5bd87c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd006d990 con 0x7f5bd015fcc0 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.702+0000 7f5bd87c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd00d02c0 con 0x7f5bd00cee60 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.702+0000 7f5bd87c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd0162c90 con 0x7f5bd015e930 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5d63640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5bd015fcc0 0x7f5bd006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43402/0 (socket says 172.21.15.18:43402) 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5d63640 1 -- 172.21.15.18:0/1017794581 learned_addr learned my addr 172.21.15.18:0/1017794581 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd6564640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bd0163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937124144 0 0) 0x7f5bd006d990 con 0x7f5bd015fcc0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd6d65640 1 --2- 172.21.15.18:0/1017794581 >> v2:172.21.15.104:3300/0 conn(0x7f5bd00cee60 0x7f5bd00cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bbc003520 con 0x7f5bd015fcc0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 285525637 0 0) 0x7f5bbc003520 con 0x7f5bd015fcc0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 msgr2=0x7f5bd0163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bd0163120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 >> v2:172.21.15.104:3300/0 conn(0x7f5bd00cee60 msgr2=0x7f5bd00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 --2- 172.21.15.18:0/1017794581 >> v2:172.21.15.104:3300/0 conn(0x7f5bd00cee60 0x7f5bd00cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd006d6b0 con 0x7f5bd015fcc0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f5bcc001670 con 0x7f5bd015fcc0 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 >> v1:172.21.15.18:6789/0 conn(0x7f5bd015fcc0 legacy=0x7f5bd006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc0039b0 0x7f5bbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bbc004800 0x7f5bbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0162c90 con 0x7f5bbc004800 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00b9c0 con 0x7f5bbc0039b0 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc00bb40 con 0x7f5bd015e930 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd5d63640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bbc004800 0x7f5bbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd6564640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc0039b0 0x7f5bbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.703+0000 7f5bd6d65640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 -- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 msgr2=0x7f5bbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd015e930 0x7f5bbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 -- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc0039b0 msgr2=0x7f5bbc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:23.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc0039b0 0x7f5bbc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 -- 172.21.15.18:0/1017794581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc003520 con 0x7f5bbc004800 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5d63640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bbc004800 0x7f5bbc004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c210 tx=0x7f5bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336e15d733004ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.704+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc007d30 con 0x7f5bbc004800 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc030070 con 0x7f5bbc004800 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd5562640 1 -- 172.21.15.18:0/1017794581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc005d30 con 0x7f5bbc004800 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 -- 172.21.15.18:0/1017794581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bbc004800 msgr2=0x7f5bbc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/1017794581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bbc004800 0x7f5bbc004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c210 tx=0x7f5bbc005830 comp rx=0 tx=0).stop 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd6d65640 1 -- 172.21.15.18:0/1017794581 reap_dead start 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 -- 172.21.15.18:0/1017794581 shutdown_connections 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 -- 172.21.15.18:0/1017794581 >> 172.21.15.18:0/1017794581 conn(0x7f5bd00b4230 msgr2=0x7f5bd00b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 -- 172.21.15.18:0/1017794581 shutdown_connections 2024-04-16T12:56:23.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.705+0000 7f5bd87c8640 1 -- 172.21.15.18:0/1017794581 wait complete. 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.706+0000 7f5bd87c8640 1 Processor -- start 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.706+0000 7f5bd87c8640 1 -- start start 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc004800 0x7f5bd014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd0158490 0x7f5bd00b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd015ed10 con 0x7f5bd00cae90 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0162920 con 0x7f5bbc004800 2024-04-16T12:56:23.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd87c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd00cc770 con 0x7f5bd0158490 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45686/0 (socket says 172.21.15.18:45686) 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 -- 172.21.15.18:0/3803691578 learned_addr learned my addr 172.21.15.18:0/3803691578 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd5d63640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd0158490 0x7f5bd00b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6564640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc004800 0x7f5bd014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 -- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd0158490 msgr2=0x7f5bd00b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd0158490 0x7f5bd00b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 -- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc004800 msgr2=0x7f5bd014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc004800 0x7f5bd014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.707+0000 7f5bd6d65640 1 -- 172.21.15.18:0/3803691578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd00cbb60 con 0x7f5bd00cae90 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bd6d65640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0073ae0 tx=0x7f5bc800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8015430 con 0x7f5bd00cae90 2024-04-16T12:56:23.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc801d070 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd00cbe40 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8015830 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.708+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd00cc400 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.709+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd00c78f0 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.709+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bc80159d0 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.710+0000 7f5bc2ffd640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 0x7f5bb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.710+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f5bc808c6a0 con 0x7f5bd00cae90 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.710+0000 7f5bd6564640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 0x7f5bb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.711+0000 7f5bd6564640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 0x7f5bb406ede0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40099c0 tx=0x7f5bc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:23.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.714+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bc8010040 con 0x7f5bd00cae90 2024-04-16T12:56:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.901+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bd0068a70 con 0x7f5bd00cae90 2024-04-16T12:56:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.902+0000 7f5bc2ffd640 1 -- 172.21.15.18:0/3803691578 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7f5bc805a940 con 0x7f5bd00cae90 2024-04-16T12:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:56:22.604463+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:56:20.273104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T12:56:21.555572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 msgr2=0x7f5bb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 0x7f5bb406ede0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40099c0 tx=0x7f5bc4008040 comp rx=0 tx=0).stop 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 msgr2=0x7f5bd00cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0073ae0 tx=0x7f5bc800f580 comp rx=0 tx=0).stop 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 shutdown_connections 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5bb406c920 0x7f5bb406ede0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bd00cae90 0x7f5bd00cb310 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5bd0158490 0x7f5bd00b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 --2- 172.21.15.18:0/3803691578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5bbc004800 0x7f5bd014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.904+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 >> 172.21.15.18:0/3803691578 conn(0x7f5bd00b4230 msgr2=0x7f5bd00c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.905+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 shutdown_connections 2024-04-16T12:56:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:23.905+0000 7f5bd87c8640 1 -- 172.21.15.18:0/3803691578 wait complete. 2024-04-16T12:56:23.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T12:56:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.024+0000 7f1561574640 1 Processor -- start 2024-04-16T12:56:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.024+0000 7f1561574640 1 -- start start 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1561574640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f155c0b37e0 0x7f155c0d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1561574640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155c0d2d90 con 0x7f155c15eca0 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1561574640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155c0d3070 con 0x7f155c0d4370 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1561574640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f155c15f080 con 0x7f155c0b37e0 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1553fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f155c0b37e0 0x7f155c0d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f155affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f155c15eca0 0x7f155c06c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43416/0 (socket says 172.21.15.18:43416) 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f155affd640 1 -- 172.21.15.18:0/944720723 learned_addr learned my addr 172.21.15.18:0/944720723 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1553fff640 1 -- 172.21.15.18:0/944720723 >> v1:172.21.15.104:6789/0 conn(0x7f155c0d4370 legacy=0x7f155c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1553fff640 1 -- 172.21.15.18:0/944720723 >> v1:172.21.15.18:6789/0 conn(0x7f155c15eca0 legacy=0x7f155c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f155a7fc640 1 -- 172.21.15.18:0/944720723 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221831816 0 0) 0x7f155c0d2d90 con 0x7f155c15eca0 2024-04-16T12:56:24.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.025+0000 7f1553fff640 1 -- 172.21.15.18:0/944720723 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c0d3350 con 0x7f155c0b37e0 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.026+0000 7f1553fff640 1 --2- 172.21.15.18:0/944720723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0b37e0 0x7f155c0d3e30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f15440097a0 tx=0x7f154402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac69089c15c70f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.026+0000 7f155a7fc640 1 -- 172.21.15.18:0/944720723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154402f810 con 0x7f155c0b37e0 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.026+0000 7f155a7fc640 1 -- 172.21.15.18:0/944720723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154402f9b0 con 0x7f155c0b37e0 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.026+0000 7f155a7fc640 1 -- 172.21.15.18:0/944720723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154402fd80 con 0x7f155c0b37e0 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 -- 172.21.15.18:0/944720723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0b37e0 msgr2=0x7f155c0d3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 --2- 172.21.15.18:0/944720723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0b37e0 0x7f155c0d3e30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f15440097a0 tx=0x7f154402b9f0 comp rx=0 tx=0).stop 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 -- 172.21.15.18:0/944720723 shutdown_connections 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 --2- 172.21.15.18:0/944720723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0b37e0 0x7f155c0d3e30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 -- 172.21.15.18:0/944720723 >> 172.21.15.18:0/944720723 conn(0x7f155c0d48b0 msgr2=0x7f155c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 -- 172.21.15.18:0/944720723 shutdown_connections 2024-04-16T12:56:24.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.027+0000 7f1561574640 1 -- 172.21.15.18:0/944720723 wait complete. 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.028+0000 7f1561574640 1 Processor -- start 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.028+0000 7f1561574640 1 -- start start 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 0x7f155c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f155c15eca0 0x7f155c0acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f155c06d520 con 0x7f155c0d4370 2024-04-16T12:56:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f155c0d3910 con 0x7f155c0b37e0 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1561574640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f155c06d6a0 con 0x7f155c15eca0 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45708/0 (socket says 172.21.15.18:45708) 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 -- 172.21.15.18:0/3668471645 learned_addr learned my addr 172.21.15.18:0/3668471645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f155affd640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 0x7f155c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f155b7fe640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f155c15eca0 0x7f155c0acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 -- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f155c15eca0 msgr2=0x7f155c0acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f155c15eca0 0x7f155c0acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 -- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 msgr2=0x7f155c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 0x7f155c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 -- 172.21.15.18:0/3668471645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c0abeb0 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f155affd640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 0x7f155c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.029+0000 7f1553fff640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1544000c00 tx=0x7f15440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.030+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544046070 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.030+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1544037c40 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.030+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154402fe60 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.030+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c0ac190 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.030+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c0ac750 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.031+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155c0752b0 con 0x7f155c0d4370 2024-04-16T12:56:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.031+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1544049070 con 0x7f155c0d4370 2024-04-16T12:56:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.031+0000 7f15537fe640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 0x7f153c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.032+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f15440ad470 con 0x7f155c0d4370 2024-04-16T12:56:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.032+0000 7f155affd640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 0x7f153c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.032+0000 7f155affd640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 0x7f153c06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f154c007fd0 tx=0x7f154c007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.036+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f154403e070 con 0x7f155c0d4370 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f923575c640 time 2024-04-16T12:56:24.248310+0000 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f923fb81f4c] 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.249 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr:2024-04-16T12:56:24.248+0000 7f923575c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f923575c640 time 2024-04-16T12:56:24.248310+0000 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f923fb81f4c] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.250 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.251 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.253 INFO:tasks.ceph.mds.b.smithi104.stderr:*** Caught signal (Aborted) ** 2024-04-16T12:56:24.254 INFO:tasks.ceph.mds.b.smithi104.stderr: in thread 7f923575c640 thread_name:ms_dispatch 2024-04-16T12:56:24.254 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f923f254db0] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f923f2a154c] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: raise() 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: abort() 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f923fb81fa6] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr:2024-04-16T12:56:24.248+0000 7f923575c640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: in thread 7f923575c640 thread_name:ms_dispatch 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.255 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f923f254db0] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f923f2a154c] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: raise() 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: abort() 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f923fb81fa6] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.256 INFO:tasks.ceph.mds.b.smithi104.stderr: -1> 2024-04-16T12:56:24.248+0000 7f923575c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f923575c640 time 2024-04-16T12:56:24.248310+0000 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f923fb81f4c] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 0> 2024-04-16T12:56:24.248+0000 7f923575c640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: in thread 7f923575c640 thread_name:ms_dispatch 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.257 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f923f254db0] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f923f2a154c] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: raise() 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: abort() 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f923fb81fa6] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.258 INFO:tasks.ceph.mds.b.smithi104.stderr: -1> 2024-04-16T12:56:24.248+0000 7f923575c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f923575c640 time 2024-04-16T12:56:24.248310+0000 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f923fb81f4c] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 0> 2024-04-16T12:56:24.248+0000 7f923575c640 -1 *** Caught signal (Aborted) ** 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: in thread 7f923575c640 thread_name:ms_dispatch 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.259 INFO:tasks.ceph.mds.b.smithi104.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f923f254db0] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f923f2a154c] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 3: raise() 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 4: abort() 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f923fb81fa6] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f923fb8210a] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 7: (MDLog::trim()+0xf2a) [0x55c6a7e421aa] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55c6a7e42559] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f923f6db924] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f923f29f802] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f923f23f450] 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T12:56:24.260 INFO:tasks.ceph.mds.b.smithi104.stderr: 2024-04-16T12:56:24.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:24.264+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f155c0b8e30 con 0x7f155c0d4370 2024-04-16T12:56:24.534 INFO:tasks.ceph.mds.b.smithi104.stderr:daemon-helper: command crashed with signal 6 2024-04-16T12:56:25.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.248+0000 7f15537fe640 1 -- 172.21.15.18:0/3668471645 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f1544033030 con 0x7f155c0d4370 2024-04-16T12:56:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 msgr2=0x7f153c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 0x7f153c06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f154c007fd0 tx=0x7f154c007dc0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 msgr2=0x7f155c0cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1544000c00 tx=0x7f15440046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 shutdown_connections 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f153c06c8f0 0x7f153c06edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f155c15eca0 0x7f155c0acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f155c0d4370 0x7f155c0cec60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 --2- 172.21.15.18:0/3668471645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f155c0b37e0 0x7f155c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 >> 172.21.15.18:0/3668471645 conn(0x7f155c0d48b0 msgr2=0x7f155c0d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 shutdown_connections 2024-04-16T12:56:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.251+0000 7f1561574640 1 -- 172.21.15.18:0/3668471645 wait complete. 2024-04-16T12:56:25.266 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T12:56:25.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T12:56:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.379+0000 7f2e61a1b640 1 Processor -- start 2024-04-16T12:56:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.379+0000 7f2e61a1b640 1 -- start start 2024-04-16T12:56:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 0x7f2e5c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 0x7f2e5c06bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c15f350 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c0d2470 con 0x7f2e5c15ef70 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e61a1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d2a30 con 0x7f2e5c0b3a00 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e5b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e5b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45716/0 (socket says 172.21.15.18:45716) 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e5b7fe640 1 -- 172.21.15.18:0/898469936 learned_addr learned my addr 172.21.15.18:0/898469936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e5a7fc640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 0x7f2e5c06bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.380+0000 7f2e5affd640 1 --2- 172.21.15.18:0/898469936 >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 0x7f2e5c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 -- 172.21.15.18:0/898469936 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 msgr2=0x7f2e5c06bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 0x7f2e5c06bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 -- 172.21.15.18:0/898469936 >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 msgr2=0x7f2e5c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 --2- 172.21.15.18:0/898469936 >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 0x7f2e5c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 -- 172.21.15.18:0/898469936 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c163480 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5affd640 1 --2- 172.21.15.18:0/898469936 >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 0x7f2e5c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5a7fc640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 0x7f2e5c06bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.381+0000 7f2e5b7fe640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b7350 tx=0x7f2e5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e57c2fcee3e2f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e59ffb640 1 -- 172.21.15.18:0/898469936 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54035020 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e59ffb640 1 -- 172.21.15.18:0/898469936 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54031870 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e59ffb640 1 -- 172.21.15.18:0/898469936 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54031c40 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 -- 172.21.15.18:0/898469936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 msgr2=0x7f2e5c0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b7350 tx=0x7f2e5402b910 comp rx=0 tx=0).stop 2024-04-16T12:56:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 -- 172.21.15.18:0/898469936 shutdown_connections 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c0cf390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/898469936 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c0b3a00 0x7f2e5c06bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/898469936 >> v2:172.21.15.104:3300/0 conn(0x7f2e5c15ef70 0x7f2e5c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 -- 172.21.15.18:0/898469936 >> 172.21.15.18:0/898469936 conn(0x7f2e5c0b69e0 msgr2=0x7f2e5c0d48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 -- 172.21.15.18:0/898469936 shutdown_connections 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.382+0000 7f2e61a1b640 1 -- 172.21.15.18:0/898469936 wait complete. 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.383+0000 7f2e61a1b640 1 Processor -- start 2024-04-16T12:56:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 -- start start 2024-04-16T12:56:25.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e5c0b3a00 0x7f2e5c1e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c15ef70 0x7f2e5c1e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d5160 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d26c0 con 0x7f2e5c0b3a00 2024-04-16T12:56:25.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e61a1b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c0cf8d0 con 0x7f2e5c15ef70 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45726/0 (socket says 172.21.15.18:45726) 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.384+0000 7f2e5affd640 1 -- 172.21.15.18:0/4071569659 learned_addr learned my addr 172.21.15.18:0/4071569659 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5a7fc640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e5c0b3a00 0x7f2e5c1e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5b7fe640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c15ef70 0x7f2e5c1e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 -- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c15ef70 msgr2=0x7f2e5c1e8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c15ef70 0x7f2e5c1e8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 -- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e5c0b3a00 msgr2=0x7f2e5c1e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e5c0b3a00 0x7f2e5c1e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 -- 172.21.15.18:0/4071569659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c0ca620 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e5affd640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c007ef0 tx=0x7f2e4c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c01a070 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c003b90 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c0cd500 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004030 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.385+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c0cda80 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.386+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c0752b0 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.387+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e4c01d070 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.387+0000 7f2e53fff640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.387+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f2e4c08be70 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.387+0000 7f2e5a7fc640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:25.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.388+0000 7f2e5a7fc640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006fd0 tx=0x7f2e44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:25.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.392+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e4c010070 con 0x7f2e5c0b34b0 2024-04-16T12:56:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:25.617+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2e5c0d1100 con 0x7f2e5c0b34b0 2024-04-16T12:56:26.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.249+0000 7f2e53fff640 1 -- 172.21.15.18:0/4071569659 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f2e4c059b50 con 0x7f2e5c0b34b0 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 msgr2=0x7f2e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006fd0 tx=0x7f2e44008040 comp rx=0 tx=0).stop 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 msgr2=0x7f2e5c157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c007ef0 tx=0x7f2e4c00d4a0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 shutdown_connections 2024-04-16T12:56:26.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2e5c15ef70 0x7f2e5c1e8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e5c0b3a00 0x7f2e5c1e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 --2- 172.21.15.18:0/4071569659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e5c0b34b0 0x7f2e5c157900 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 >> 172.21.15.18:0/4071569659 conn(0x7f2e5c0b69e0 msgr2=0x7f2e5c0b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 shutdown_connections 2024-04-16T12:56:26.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.251+0000 7f2e61a1b640 1 -- 172.21.15.18:0/4071569659 wait complete. 2024-04-16T12:56:26.266 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T12:56:26.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.373+0000 7f5d59d1c640 1 Processor -- start 2024-04-16T12:56:26.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.373+0000 7f5d59d1c640 1 -- start start 2024-04-16T12:56:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d59d1c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 0x7f5d5409b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d59d1c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5d5409aa10 0x7f5d5409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d59d1c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d54070e10 con 0x7f5d54071400 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d59d1c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5d540d2480 con 0x7f5d5409aa10 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d59d1c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f5d540720c0 con 0x7f5d540d1740 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5d5409aa10 0x7f5d5409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5d5409aa10 0x7f5d5409aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45728/0 (socket says 172.21.15.18:45728) 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 -- 172.21.15.18:0/623643166 learned_addr learned my addr 172.21.15.18:0/623643166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d537fe640 1 --2- 172.21.15.18:0/623643166 >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 0x7f5d5409b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 -- 172.21.15.18:0/623643166 >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 msgr2=0x7f5d5409b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 --2- 172.21.15.18:0/623643166 >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 0x7f5d5409b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 -- 172.21.15.18:0/623643166 >> v1:172.21.15.104:6789/0 conn(0x7f5d54071400 legacy=0x7f5d540d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d53fff640 1 -- 172.21.15.18:0/623643166 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d540d21a0 con 0x7f5d5409aa10 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.374+0000 7f5d537fe640 1 --2- 172.21.15.18:0/623643166 >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 0x7f5d5409b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.375+0000 7f5d53fff640 1 --2- 172.21.15.18:0/623643166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d5409aa10 0x7f5d5409aea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5d54072270 tx=0x7f5d4c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bf6f05d5294264 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.375+0000 7f5d527fc640 1 -- 172.21.15.18:0/623643166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c02ca80 con 0x7f5d5409aa10 2024-04-16T12:56:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.375+0000 7f5d527fc640 1 -- 172.21.15.18:0/623643166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4c02cc20 con 0x7f5d5409aa10 2024-04-16T12:56:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.375+0000 7f5d527fc640 1 -- 172.21.15.18:0/623643166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0343f0 con 0x7f5d5409aa10 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 -- 172.21.15.18:0/623643166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d5409aa10 msgr2=0x7f5d5409aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/623643166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d5409aa10 0x7f5d5409aea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5d54072270 tx=0x7f5d4c02bee0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 -- 172.21.15.18:0/623643166 shutdown_connections 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/623643166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d5409aa10 0x7f5d5409aea0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/623643166 >> v2:172.21.15.104:3300/0 conn(0x7f5d540d1740 0x7f5d5409b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 -- 172.21.15.18:0/623643166 >> 172.21.15.18:0/623643166 conn(0x7f5d540d2600 msgr2=0x7f5d540d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 -- 172.21.15.18:0/623643166 shutdown_connections 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.376+0000 7f5d59d1c640 1 -- 172.21.15.18:0/623643166 wait complete. 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.377+0000 7f5d59d1c640 1 Processor -- start 2024-04-16T12:56:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.377+0000 7f5d59d1c640 1 -- start start 2024-04-16T12:56:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d5409aa10 0x7f5d540b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d540d1740 0x7f5d540b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d540d1b20 con 0x7f5d54071400 2024-04-16T12:56:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5406cb30 con 0x7f5d5409aa10 2024-04-16T12:56:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d59d1c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5406d050 con 0x7f5d540d1740 2024-04-16T12:56:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45730/0 (socket says 172.21.15.18:45730) 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 -- 172.21.15.18:0/2905817002 learned_addr learned my addr 172.21.15.18:0/2905817002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d53fff640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d540d1740 0x7f5d540b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d52ffd640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d5409aa10 0x7f5d540b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 -- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d540d1740 msgr2=0x7f5d540b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d540d1740 0x7f5d540b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 -- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d5409aa10 msgr2=0x7f5d540b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d5409aa10 0x7f5d540b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 -- 172.21.15.18:0/2905817002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d540af880 con 0x7f5d54071400 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.378+0000 7f5d537fe640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c7f0 tx=0x7f5d4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.379+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44015070 con 0x7f5d54071400 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.379+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44007820 con 0x7f5d54071400 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.379+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44007bd0 con 0x7f5d54071400 2024-04-16T12:56:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.379+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d540afbc0 con 0x7f5d54071400 2024-04-16T12:56:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.379+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d540b0400 con 0x7f5d54071400 2024-04-16T12:56:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.380+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d540752b0 con 0x7f5d54071400 2024-04-16T12:56:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.380+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d44018070 con 0x7f5d54071400 2024-04-16T12:56:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.381+0000 7f5d3bfff640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 0x7f5d4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.381+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f5d4408be50 con 0x7f5d54071400 2024-04-16T12:56:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.381+0000 7f5d52ffd640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 0x7f5d4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.381+0000 7f5d52ffd640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 0x7f5d4006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5d540b4090 tx=0x7f5d48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.385+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d540afbc0 con 0x7f5d54071400 2024-04-16T12:56:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.607+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d540b5cd0 con 0x7f5d54071400 2024-04-16T12:56:26.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.608+0000 7f5d3bfff640 1 -- 172.21.15.18:0/2905817002 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7f5d4405a0f0 con 0x7f5d54071400 2024-04-16T12:56:26.609 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:26.610 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2705826407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2705826407},{"type":"v1","addr":"172.21.15.104:6837","nonce":2705826407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2742340700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2742340700},{"type":"v1","addr":"172.21.15.18:6834","nonce":2742340700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2957312314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2957312314},{"type":"v1","addr":"172.21.15.18:6835","nonce":2957312314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:56:22.604428+0000","modified":"2024-04-16T12:56:25.618820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54743":{"gid":54743,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6836/632577351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":632577351},{"type":"v1","addr":"172.21.15.104:6836","nonce":632577351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54743,"qdb_cluster":[54743]},"id":2}]} 2024-04-16T12:56:26.610 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-04-16T12:56:26.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 msgr2=0x7f5d4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 0x7f5d4006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5d540b4090 tx=0x7f5d48009040 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 msgr2=0x7f5d540b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c7f0 tx=0x7f5d4400ccb0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 shutdown_connections 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5d4006c8f0 0x7f5d4006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5d540d1740 0x7f5d540b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d5409aa10 0x7f5d540b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 --2- 172.21.15.18:0/2905817002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d54071400 0x7f5d540b3b50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 >> 172.21.15.18:0/2905817002 conn(0x7f5d540d2600 msgr2=0x7f5d54162440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 shutdown_connections 2024-04-16T12:56:26.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.610+0000 7f5d59d1c640 1 -- 172.21.15.18:0/2905817002 wait complete. 2024-04-16T12:56:26.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:26.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.725+0000 7f8680e55640 1 Processor -- start 2024-04-16T12:56:26.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.725+0000 7f8680e55640 1 -- start start 2024-04-16T12:56:26.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8680e55640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f867c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8680e55640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c162300 con 0x7f867c09bc20 2024-04-16T12:56:26.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8680e55640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c071d80 con 0x7f867c09aa10 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8680e55640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0c9520 con 0x7f867c09b660 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8679d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f867c09bc20 0x7f867c0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43422/0 (socket says 172.21.15.18:43422) 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.726+0000 7f8679d9b640 1 -- 172.21.15.18:0/4172613459 learned_addr learned my addr 172.21.15.18:0/4172613459 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867ad9d640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f867c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759209630 0 0) 0x7f867c162300 con 0x7f867c09bc20 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8668003520 con 0x7f867c09bc20 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1671618621 0 0) 0x7f8668003520 con 0x7f867c09bc20 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 msgr2=0x7f867c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f867c070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 >> v1:172.21.15.104:6789/0 conn(0x7f867c09aa10 legacy=0x7f867c09adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c072060 con 0x7f867c09bc20 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f8664001670 con 0x7f867c09bc20 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 >> v1:172.21.15.18:6789/0 conn(0x7f867c09bc20 legacy=0x7f867c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86680039e0 0x7f8668003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8668004390 0x7f8668004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f86680050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f866800b9c0 con 0x7f8668004390 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f866800bb40 con 0x7f86680039e0 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f866800bd40 con 0x7f867c09b660 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8668004390 0x7f8668004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867a59c640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86680039e0 0x7f8668003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f867ad9d640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f86680050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 -- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 msgr2=0x7f86680050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f867c09b660 0x7f86680050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 -- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86680039e0 msgr2=0x7f8668003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86680039e0 0x7f8668003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.727+0000 7f8679d9b640 1 -- 172.21.15.18:0/4172613459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8668003520 con 0x7f8668004390 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.728+0000 7f8679d9b640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8668004390 0x7f8668004860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8664007fd0 tx=0x7f8668005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f85f7fbcae4d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.728+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664007d50 con 0x7f8668004390 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.728+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8664030070 con 0x7f8668004390 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.728+0000 7f867959a640 1 -- 172.21.15.18:0/4172613459 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664005d30 con 0x7f8668004390 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 -- 172.21.15.18:0/4172613459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8668004390 msgr2=0x7f8668004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 --2- 172.21.15.18:0/4172613459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8668004390 0x7f8668004860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8664007fd0 tx=0x7f8668005830 comp rx=0 tx=0).stop 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f867ad9d640 1 -- 172.21.15.18:0/4172613459 reap_dead start 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 -- 172.21.15.18:0/4172613459 shutdown_connections 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 -- 172.21.15.18:0/4172613459 >> 172.21.15.18:0/4172613459 conn(0x7f867c0d2600 msgr2=0x7f867c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 -- 172.21.15.18:0/4172613459 shutdown_connections 2024-04-16T12:56:26.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.729+0000 7f8680e55640 1 -- 172.21.15.18:0/4172613459 wait complete. 2024-04-16T12:56:26.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.730+0000 7f8680e55640 1 Processor -- start 2024-04-16T12:56:26.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.730+0000 7f8680e55640 1 -- start start 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8668004390 0x7f867c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 0x7f867c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f867c06d8c0 con 0x7f867c160940 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f867c06dba0 con 0x7f867c1f7a20 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8680e55640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f867c071a30 con 0x7f8668004390 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45738/0 (socket says 172.21.15.18:45738) 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 -- 172.21.15.18:0/3755835594 learned_addr learned my addr 172.21.15.18:0/3755835594 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f8679d9b640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 0x7f867c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867a59c640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8668004390 0x7f867c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 -- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8668004390 msgr2=0x7f867c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8668004390 0x7f867c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 -- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 msgr2=0x7f867c0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.731+0000 7f867ad9d640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 0x7f867c0b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f867ad9d640 1 -- 172.21.15.18:0/3755835594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c0b5190 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8679d9b640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 0x7f867c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f867ad9d640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f867c0b5160 tx=0x7f866c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c015430 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c01d070 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c1f7f20 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c015830 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.732+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c1f84e0 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.733+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0b5360 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.733+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f866c0159d0 con 0x7f867c160940 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.734+0000 7f8672ffd640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 0x7f865c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.734+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f866c08c5e0 con 0x7f867c160940 2024-04-16T12:56:26.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.734+0000 7f867a59c640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 0x7f865c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:26.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.735+0000 7f867a59c640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 0x7f865c06ede0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8674003640 tx=0x7f8674009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:26.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.738+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f866c010040 con 0x7f867c160940 2024-04-16T12:56:26.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.925+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f867c0752b0 con 0x7f867c160940 2024-04-16T12:56:26.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.926+0000 7f8672ffd640 1 -- 172.21.15.18:0/3755835594 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16942 (secure 0 0 0) 0x7f866c05a880 con 0x7f867c160940 2024-04-16T12:56:26.927 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:26.928 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:56:24.231988+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:56:20.273104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T12:56:21.555572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:26.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 msgr2=0x7f865c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 0x7f865c06ede0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8674003640 tx=0x7f8674009040 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 msgr2=0x7f867c160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f867c0b5160 tx=0x7f866c00f580 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 shutdown_connections 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f865c06c920 0x7f865c06ede0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f867c160940 0x7f867c160df0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f867c1f7a20 0x7f867c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 --2- 172.21.15.18:0/3755835594 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8668004390 0x7f867c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 >> 172.21.15.18:0/3755835594 conn(0x7f867c0d2600 msgr2=0x7f867c15c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:26.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 shutdown_connections 2024-04-16T12:56:26.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:26.928+0000 7f8680e55640 1 -- 172.21.15.18:0/3755835594 wait complete. 2024-04-16T12:56:26.940 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T12:56:26.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.044+0000 7f0b1fd24640 1 Processor -- start 2024-04-16T12:56:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.044+0000 7f0b1fd24640 1 -- start start 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1fd24640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b180b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1fd24640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b1806ba20 0x7f0b1806bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1fd24640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1806c6c0 con 0x7f0b18162240 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1fd24640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1806c9a0 con 0x7f0b1806ba20 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1fd24640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0b180d2db0 con 0x7f0b1806d520 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1e2c1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b1806ba20 0x7f0b1806bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1dac0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b18162240 0x7f0b1806ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43426/0 (socket says 172.21.15.18:43426) 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1dac0640 1 -- 172.21.15.18:0/1499011387 learned_addr learned my addr 172.21.15.18:0/1499011387 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b180b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1e2c1640 1 -- 172.21.15.18:0/1499011387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 msgr2=0x7f0b180b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1e2c1640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b180b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1e2c1640 1 -- 172.21.15.18:0/1499011387 >> v1:172.21.15.18:6789/0 conn(0x7f0b18162240 legacy=0x7f0b1806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1e2c1640 1 -- 172.21.15.18:0/1499011387 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b180d3090 con 0x7f0b1806ba20 2024-04-16T12:56:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1cabe640 1 -- 172.21.15.18:0/1499011387 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533599873 0 0) 0x7f0b1806c6c0 con 0x7f0b18162240 2024-04-16T12:56:27.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.045+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b180b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.046+0000 7f0b1e2c1640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b1806bea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009d90 tx=0x7f0b1002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae6fe9fbb1239f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.046+0000 7f0b1cabe640 1 -- 172.21.15.18:0/1499011387 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10039070 con 0x7f0b1806ba20 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.046+0000 7f0b1cabe640 1 -- 172.21.15.18:0/1499011387 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1002cbc0 con 0x7f0b1806ba20 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.046+0000 7f0b1cabe640 1 -- 172.21.15.18:0/1499011387 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10034440 con 0x7f0b1806ba20 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 -- 172.21.15.18:0/1499011387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 msgr2=0x7f0b1806bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b1806bea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009d90 tx=0x7f0b1002be10 comp rx=0 tx=0).stop 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 -- 172.21.15.18:0/1499011387 shutdown_connections 2024-04-16T12:56:27.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b1806bea0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/1499011387 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b180b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 -- 172.21.15.18:0/1499011387 >> 172.21.15.18:0/1499011387 conn(0x7f0b180d48b0 msgr2=0x7f0b180d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 -- 172.21.15.18:0/1499011387 shutdown_connections 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.047+0000 7f0b1fd24640 1 -- 172.21.15.18:0/1499011387 wait complete. 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.048+0000 7f0b1fd24640 1 Processor -- start 2024-04-16T12:56:27.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.048+0000 7f0b1fd24640 1 -- start start 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.048+0000 7f0b1fd24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.048+0000 7f0b1fd24640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b1815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.048+0000 7f0b1fd24640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b18162240 0x7f0b180c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1fd24640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b180d3a10 con 0x7f0b1806ba20 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1fd24640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b180d3890 con 0x7f0b18162240 2024-04-16T12:56:27.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1fd24640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0b180d3b90 con 0x7f0b1806d520 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45760/0 (socket says 172.21.15.18:45760) 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 -- 172.21.15.18:0/2727587783 learned_addr learned my addr 172.21.15.18:0/2727587783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1e2c1640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b18162240 0x7f0b180c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b1815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 -- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 msgr2=0x7f0b1815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b1815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 -- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b18162240 msgr2=0x7f0b180c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b18162240 0x7f0b180c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 -- 172.21.15.18:0/2727587783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1815db00 con 0x7f0b1806ba20 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b1815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1dac0640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c430 tx=0x7f0b1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140074e0 con 0x7f0b1806ba20 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b140047e0 con 0x7f0b1806ba20 2024-04-16T12:56:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1815dde0 con 0x7f0b1806ba20 2024-04-16T12:56:27.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14004bd0 con 0x7f0b1806ba20 2024-04-16T12:56:27.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.049+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1815d6d0 con 0x7f0b1806ba20 2024-04-16T12:56:27.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.050+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b180752b0 con 0x7f0b1806ba20 2024-04-16T12:56:27.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.051+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b14011070 con 0x7f0b1806ba20 2024-04-16T12:56:27.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.051+0000 7f0b0e7fc640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.051+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f0b1408b8a0 con 0x7f0b1806ba20 2024-04-16T12:56:27.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.051+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.052+0000 7f0b1d2bf640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 0x7f0afc06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b1815c470 tx=0x7f0b08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.056+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b14059bd0 con 0x7f0b1806ba20 2024-04-16T12:56:27.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.237+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b180d27b0 con 0x7f0afc06c8f0 2024-04-16T12:56:27.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.244+0000 7f0b0e7fc640 1 -- 172.21.15.18:0/2727587783 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f0b180d27b0 con 0x7f0afc06c8f0 2024-04-16T12:56:27.248 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:27.250 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 msgr2=0x7f0afc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 0x7f0afc06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0b1815c470 tx=0x7f0b08008040 comp rx=0 tx=0).stop 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 msgr2=0x7f0b18149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c430 tx=0x7f0b1400c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 shutdown_connections 2024-04-16T12:56:27.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b18162240 0x7f0b180c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b1806d520 0x7f0b1815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 --2- 172.21.15.18:0/2727587783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b1806ba20 0x7f0b18149e30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 >> 172.21.15.18:0/2727587783 conn(0x7f0b180d48b0 msgr2=0x7f0b180d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 shutdown_connections 2024-04-16T12:56:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.247+0000 7f0b1fd24640 1 -- 172.21.15.18:0/2727587783 wait complete. 2024-04-16T12:56:27.260 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-16T12:56:26.537858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.310585"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:27.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.404+0000 7fe7edd1c640 1 Processor -- start 2024-04-16T12:56:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.404+0000 7fe7edd1c640 1 -- start start 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7edd1c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe7e806d520 0x7fe7e80b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7edd1c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 0x7fe7e806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7edd1c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e806c410 con 0x7fe7e8162240 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7edd1c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e806c9a0 con 0x7fe7e806d520 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7edd1c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e806c6c0 con 0x7fe7e806ba20 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7e6ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe7e806d520 0x7fe7e80b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.405+0000 7fe7e7fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 0x7fe7e806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe7e806d520 0x7fe7e80b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:33560/0 (socket says 172.21.15.18:33560) 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e7fff640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 0x7fe7e806bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:43954/0 (socket says 172.21.15.18:43954) 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/2142279003 learned_addr learned my addr 172.21.15.18:0/2142279003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 msgr2=0x7fe7e806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 --2- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 0x7fe7e806bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/2142279003 >> v1:172.21.15.104:6789/0 conn(0x7fe7e8162240 legacy=0x7fe7e806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.406+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/2142279003 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e80d2db0 con 0x7fe7e806d520 2024-04-16T12:56:27.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7e6ffd640 1 --2- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806d520 0x7fe7e80b7b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009870 tx=0x7fe7dc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47edb4e56e490b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7e67fc640 1 -- 172.21.15.18:0/2142279003 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc035020 con 0x7fe7e806d520 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7e67fc640 1 -- 172.21.15.18:0/2142279003 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc031640 con 0x7fe7e806d520 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7e67fc640 1 -- 172.21.15.18:0/2142279003 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc02d040 con 0x7fe7e806d520 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 -- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806d520 msgr2=0x7fe7e80b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806d520 0x7fe7e80b7b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009870 tx=0x7fe7dc02b8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 -- 172.21.15.18:0/2142279003 shutdown_connections 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e806ba20 0x7fe7e806bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/2142279003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806d520 0x7fe7e80b7b00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 -- 172.21.15.18:0/2142279003 >> 172.21.15.18:0/2142279003 conn(0x7fe7e80d48b0 msgr2=0x7fe7e80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 -- 172.21.15.18:0/2142279003 shutdown_connections 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.407+0000 7fe7edd1c640 1 -- 172.21.15.18:0/2142279003 wait complete. 2024-04-16T12:56:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 Processor -- start 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 -- start start 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 0x7fe7e81f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e8162240 0x7fe7e80cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80d3a10 con 0x7fe7e806d520 2024-04-16T12:56:27.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80d3890 con 0x7fe7e806ba20 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.409+0000 7fe7edd1c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e80d3b90 con 0x7fe7e8162240 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45770/0 (socket says 172.21.15.18:45770) 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/717187742 learned_addr learned my addr 172.21.15.18:0/717187742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e77fe640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 0x7fe7e81f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e7fff640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e8162240 0x7fe7e80cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e8162240 msgr2=0x7fe7e80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e8162240 0x7fe7e80cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 msgr2=0x7fe7e81f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 0x7fe7e81f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 -- 172.21.15.18:0/717187742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e80ca3d0 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e77fe640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 0x7fe7e81f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7e6ffd640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc000c00 tx=0x7fe7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc040070 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc0399f0 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e80c9610 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc035040 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.410+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e80c9bd0 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.411+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e80752b0 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.412+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7dc04b060 con 0x7fe7e806d520 2024-04-16T12:56:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.412+0000 7fe7cffff640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 0x7fe7d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.412+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe7dc0ad4f0 con 0x7fe7e806d520 2024-04-16T12:56:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.413+0000 7fe7e77fe640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 0x7fe7d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.413+0000 7fe7e77fe640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 0x7fe7d406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8001ad0 tx=0x7fe7d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.417+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7dc07b0b0 con 0x7fe7e806d520 2024-04-16T12:56:27.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.598+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7e80b3170 con 0x7fe7d406c8f0 2024-04-16T12:56:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.605+0000 7fe7cffff640 1 -- 172.21.15.18:0/717187742 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7fe7e80b3170 con 0x7fe7d406c8f0 2024-04-16T12:56:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:27.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 msgr2=0x7fe7d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 0x7fe7d406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8001ad0 tx=0x7fe7d8009040 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 msgr2=0x7fe7e80cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc000c00 tx=0x7fe7dc0046c0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 shutdown_connections 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe7d406c8f0 0x7fe7d406edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe7e8162240 0x7fe7e80cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7e806d520 0x7fe7e80cd990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 --2- 172.21.15.18:0/717187742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7e806ba20 0x7fe7e81f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.607+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 >> 172.21.15.18:0/717187742 conn(0x7fe7e80d48b0 msgr2=0x7fe7e80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.608+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 shutdown_connections 2024-04-16T12:56:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.608+0000 7fe7edd1c640 1 -- 172.21.15.18:0/717187742 wait complete. 2024-04-16T12:56:27.620 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-16T12:56:26.537858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.310585"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:27.624 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T12:56:27.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T12:56:27.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.771+0000 7f2027d0e640 1 Processor -- start 2024-04-16T12:56:27.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.771+0000 7f2027d0e640 1 -- start start 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f2027d0e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f202015e8a0 0x7f20200d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f2027d0e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20200d0cf0 con 0x7f20200b69a0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f2027d0e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20200d0fd0 con 0x7f20200b6ea0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f2027d0e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f20200d12b0 con 0x7f202015e8a0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f20262ab640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f20200b69a0 0x7f20200cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43438/0 (socket says 172.21.15.18:43438) 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.772+0000 7f20262ab640 1 -- 172.21.15.18:0/425552321 learned_addr learned my addr 172.21.15.18:0/425552321 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2025aaa640 1 --2- 172.21.15.18:0/425552321 >> v2:172.21.15.104:3300/0 conn(0x7f202015e8a0 0x7f20200d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047607960 0 0) 0x7f20200d0cf0 con 0x7f20200b69a0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c003520 con 0x7f20200b69a0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 197339509 0 0) 0x7f200c003520 con 0x7f20200b69a0 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 >> v2:172.21.15.104:3300/0 conn(0x7f202015e8a0 msgr2=0x7f20200d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:27.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 --2- 172.21.15.18:0/425552321 >> v2:172.21.15.104:3300/0 conn(0x7f202015e8a0 0x7f20200d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 >> v1:172.21.15.104:6789/0 conn(0x7f20200b6ea0 legacy=0x7f20200b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202006f0f0 con 0x7f20200b69a0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f20180019f0 con 0x7f20200b69a0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 >> v1:172.21.15.18:6789/0 conn(0x7f20200b69a0 legacy=0x7f20200cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f200c0039b0 0x7f200c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c004800 0x7f200c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 0x7f200c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20200d12b0 con 0x7f200c0051c0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f200c00c060 con 0x7f200c0039b0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f200c00c260 con 0x7f200c004800 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f20262ab640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 0x7f200c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f2025aaa640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f200c0039b0 0x7f200c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.773+0000 7f20252a9640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c004800 0x7f200c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 -- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c004800 msgr2=0x7f200c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c004800 0x7f200c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 -- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f200c0039b0 msgr2=0x7f200c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f200c0039b0 0x7f200c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 -- 172.21.15.18:0/425552321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c003520 con 0x7f200c0051c0 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 -- 172.21.15.18:0/425552321 reap_dead start 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.774+0000 7f20262ab640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 0x7f200c00b9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20200b3ce0 tx=0x7f200c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b31674504217cac server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201800a4a0 con 0x7f200c0051c0 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018034650 con 0x7f200c0051c0 2024-04-16T12:56:27.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2024aa8640 1 -- 172.21.15.18:0/425552321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018034a40 con 0x7f200c0051c0 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 -- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 msgr2=0x7f200c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 0x7f200c00b9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f20200b3ce0 tx=0x7f200c005830 comp rx=0 tx=0).stop 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 -- 172.21.15.18:0/425552321 shutdown_connections 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 --2- 172.21.15.18:0/425552321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200c0051c0 0x7f200c00b9c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 -- 172.21.15.18:0/425552321 >> 172.21.15.18:0/425552321 conn(0x7f202009aa10 msgr2=0x7f20200b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 -- 172.21.15.18:0/425552321 shutdown_connections 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.775+0000 7f2027d0e640 1 -- 172.21.15.18:0/425552321 wait complete. 2024-04-16T12:56:27.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 Processor -- start 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 -- start start 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c0051c0 0x7f20201f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20200c6990 0x7f20200c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f202015ee00 con 0x7f202006f7b0 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f202015ec80 con 0x7f20200c6990 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.777+0000 7f2027d0e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f20200b6290 con 0x7f200c0051c0 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45788/0 (socket says 172.21.15.18:45788) 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 -- 172.21.15.18:0/1856379112 learned_addr learned my addr 172.21.15.18:0/1856379112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f2025aaa640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c0051c0 0x7f20201f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20262ab640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20200c6990 0x7f20200c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 -- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c0051c0 msgr2=0x7f20201f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c0051c0 0x7f20201f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 -- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20200c6990 msgr2=0x7f20200c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20200c6990 0x7f20200c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 -- 172.21.15.18:0/1856379112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20201f82e0 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20252a9640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f201400f5f0 tx=0x7f201400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140052e0 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2014018070 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20201f5b30 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014003810 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.778+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201f8830 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.779+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2020068a70 con 0x7f202006f7b0 2024-04-16T12:56:27.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.780+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20140039b0 con 0x7f202006f7b0 2024-04-16T12:56:27.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.780+0000 7f20127fc640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 0x7f200406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:27.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.781+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f201408b920 con 0x7f202006f7b0 2024-04-16T12:56:27.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.781+0000 7f2025aaa640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 0x7f200406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:27.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.781+0000 7f2025aaa640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 0x7f200406edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f201c009b40 tx=0x7f201c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:27.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:27.785+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20201f5b30 con 0x7f202006f7b0 2024-04-16T12:56:28.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.044+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f20200ce6d0 con 0x7f202006f7b0 2024-04-16T12:56:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.046+0000 7f20127fc640 1 -- 172.21.15.18:0/1856379112 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f2014059c50 con 0x7f202006f7b0 2024-04-16T12:56:28.047 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-16T12:56:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDvdB5mScpUJBAAg92NknOEgwOgxRDmtBQiFA== 2024-04-16T12:56:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-16T12:56:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-16T12:56:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T12:56:28.048 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 msgr2=0x7f200406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 0x7f200406edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f201c009b40 tx=0x7f201c009190 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 msgr2=0x7f202006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f201400f5f0 tx=0x7f201400f9f0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 shutdown_connections 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f200406c8f0 0x7f200406edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20200c6990 0x7f20200c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f202006f7b0 0x7f202006fc30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 --2- 172.21.15.18:0/1856379112 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f200c0051c0 0x7f20201f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 >> 172.21.15.18:0/1856379112 conn(0x7f202009aa10 msgr2=0x7f202015b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 shutdown_connections 2024-04-16T12:56:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.048+0000 7f2027d0e640 1 -- 172.21.15.18:0/1856379112 wait complete. 2024-04-16T12:56:28.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:28.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.163+0000 7f1cc491c640 1 Processor -- start 2024-04-16T12:56:28.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.163+0000 7f1cc491c640 1 -- start start 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cc491c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1cc006c630 0x7f1cc00ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cc491c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc006cab0 con 0x7f1cc006e520 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cc491c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc00cf3a0 con 0x7f1cc00cec60 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cc491c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc00cf680 con 0x7f1cc006c630 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbdd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1cc006c630 0x7f1cc00ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbe59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1cc006e520 0x7f1cc006e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43442/0 (socket says 172.21.15.18:43442) 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbe59c640 1 -- 172.21.15.18:0/3571742340 learned_addr learned my addr 172.21.15.18:0/3571742340 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbdd9b640 1 -- 172.21.15.18:0/3571742340 >> v1:172.21.15.104:6789/0 conn(0x7f1cc00cec60 legacy=0x7f1cc015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbdd9b640 1 -- 172.21.15.18:0/3571742340 >> v1:172.21.15.18:6789/0 conn(0x7f1cc006e520 legacy=0x7f1cc006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbdd9b640 1 -- 172.21.15.18:0/3571742340 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc006bb50 con 0x7f1cc006c630 2024-04-16T12:56:28.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.164+0000 7f1cbd59a640 1 -- 172.21.15.18:0/3571742340 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709304387 0 0) 0x7f1cc006cab0 con 0x7f1cc006e520 2024-04-16T12:56:28.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.165+0000 7f1cbdd9b640 1 --2- 172.21.15.18:0/3571742340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc006c630 0x7f1cc00ce720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097a0 tx=0x7f1ca802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610fc7ed21eb478 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.165+0000 7f1cbd59a640 1 -- 172.21.15.18:0/3571742340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80315a0 con 0x7f1cc006c630 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.165+0000 7f1cbd59a640 1 -- 172.21.15.18:0/3571742340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8037070 con 0x7f1cc006c630 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.165+0000 7f1cbd59a640 1 -- 172.21.15.18:0/3571742340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8031960 con 0x7f1cc006c630 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 -- 172.21.15.18:0/3571742340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc006c630 msgr2=0x7f1cc00ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3571742340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc006c630 0x7f1cc00ce720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097a0 tx=0x7f1ca802b840 comp rx=0 tx=0).stop 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 -- 172.21.15.18:0/3571742340 shutdown_connections 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3571742340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc006c630 0x7f1cc00ce720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 -- 172.21.15.18:0/3571742340 >> 172.21.15.18:0/3571742340 conn(0x7f1cc00b2990 msgr2=0x7f1cc00b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 -- 172.21.15.18:0/3571742340 shutdown_connections 2024-04-16T12:56:28.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.166+0000 7f1cc491c640 1 -- 172.21.15.18:0/3571742340 wait complete. 2024-04-16T12:56:28.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.167+0000 7f1cc491c640 1 Processor -- start 2024-04-16T12:56:28.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.167+0000 7f1cc491c640 1 -- start start 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 0x7f1cc01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1cc006e520 0x7f1cc0157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc00cf0b0 con 0x7f1cc00cec60 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc006c1a0 con 0x7f1cc006c630 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cc491c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc0157100 con 0x7f1cc006e520 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cbed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45816/0 (socket says 172.21.15.18:45816) 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.168+0000 7f1cbed9d640 1 -- 172.21.15.18:0/3272027983 learned_addr learned my addr 172.21.15.18:0/3272027983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:28.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbe59c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 0x7f1cc01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbdd9b640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1cc006e520 0x7f1cc0157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 -- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1cc006e520 msgr2=0x7f1cc0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1cc006e520 0x7f1cc0157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 -- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 msgr2=0x7f1cc01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 0x7f1cc01534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 -- 172.21.15.18:0/3272027983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc0157e00 con 0x7f1cc00cec60 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbe59c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 0x7f1cc01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cbed9d640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b9c0 tx=0x7f1cb000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0019070 con 0x7f1cc00cec60 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb000cb40 con 0x7f1cc00cec60 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc01580e0 con 0x7f1cc00cec60 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0014440 con 0x7f1cc00cec60 2024-04-16T12:56:28.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.169+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc0158980 con 0x7f1cc00cec60 2024-04-16T12:56:28.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.170+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc00752b0 con 0x7f1cc00cec60 2024-04-16T12:56:28.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.171+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1cb001c070 con 0x7f1cc00cec60 2024-04-16T12:56:28.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.171+0000 7f1cb6ffd640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 0x7f1ca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:28.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.171+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1cb008ba70 con 0x7f1cc00cec60 2024-04-16T12:56:28.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.171+0000 7f1cbe59c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 0x7f1ca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:28.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.172+0000 7f1cbe59c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 0x7f1ca006edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000f60 tx=0x7f1cb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:28.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.175+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1cb0059d10 con 0x7f1cc00cec60 2024-04-16T12:56:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.400+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cc01582b0 con 0x7f1cc00cec60 2024-04-16T12:56:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.400+0000 7f1cb6ffd640 1 -- 172.21.15.18:0/3272027983 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7f1cb0059610 con 0x7f1cc00cec60 2024-04-16T12:56:28.402 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:28.402 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2705826407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2705826407},{"type":"v1","addr":"172.21.15.104:6837","nonce":2705826407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2742340700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2742340700},{"type":"v1","addr":"172.21.15.18:6834","nonce":2742340700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2957312314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2957312314},{"type":"v1","addr":"172.21.15.18:6835","nonce":2957312314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:56:22.604428+0000","modified":"2024-04-16T12:56:25.618820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":54743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54743":{"gid":54743,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6836/632577351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":632577351},{"type":"v1","addr":"172.21.15.104:6836","nonce":632577351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":54743,"qdb_cluster":[54743]},"id":2}]} 2024-04-16T12:56:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 17 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 msgr2=0x7f1ca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 0x7f1ca006edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000f60 tx=0x7f1cb8009040 comp rx=0 tx=0).stop 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 msgr2=0x7f1cc015d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b9c0 tx=0x7f1cb000be80 comp rx=0 tx=0).stop 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 shutdown_connections 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1ca006c8f0 0x7f1ca006edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cc00cec60 0x7f1cc015d220 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1cc006e520 0x7f1cc0157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 --2- 172.21.15.18:0/3272027983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc006c630 0x7f1cc01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 >> 172.21.15.18:0/3272027983 conn(0x7f1cc00b2990 msgr2=0x7f1cc015dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.402+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 shutdown_connections 2024-04-16T12:56:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:28.403+0000 7f1cc491c640 1 -- 172.21.15.18:0/3272027983 wait complete. 2024-04-16T12:56:28.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner:test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) ... ERROR 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner: 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner:ERROR: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T12:56:28.618 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner:Ran 1 test in 32.756s 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T12:56:28.619 INFO:tasks.cephfs_test_runner: 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner:ERROR: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T12:56:28.620 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-04-16T12:56:28.621 INFO:tasks.cephfs_test_runner: 2024-04-16T12:56:28.621 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-04-16T12:56:28.865 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f25dfd322a6143c39e1c3f53df392871 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-04-16T12:56:28.866 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T12:56:28.876 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-16T12:56:28.897 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-16T12:56:28.898 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:56:28.898 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:28.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057144,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19797 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249460k,nr_inodes=812365,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T12:56:28.917 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-16T12:56:28.917 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:28.975 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057144,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19797 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249460k,nr_inodes=812365,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T12:56:28.976 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:28.976 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:28.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056370,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19027 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T12:56:28.995 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-16T12:56:28.995 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T12:56:29.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056370,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19027 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497688k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T12:56:29.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.054 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:56:29.071 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T12:56:29.071 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T12:56:29.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T12:56:29.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T12:56:29.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-16T12:56:29.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.304 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-16T12:56:29.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-16T12:56:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-04-16T12:56:29.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:56:29.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.395 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:56:29.415 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T12:56:29.415 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T12:56:29.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T12:56:29.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.489 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T12:56:29.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-04-16T12:56:29.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.658 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-04-16T12:56:29.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T12:56:29.674 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-04-16T12:56:29.747 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-04-16T12:56:29.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:56:29.749 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T12:56:29.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T12:56:29.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.864+0000 7f0b9cace640 1 Processor -- start 2024-04-16T12:56:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.864+0000 7f0b9cace640 1 -- start start 2024-04-16T12:56:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b9cace640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0b981449e0 0x7f0b9815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b9cace640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b980cd910 0x7f0b980cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b9cace640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b98144dc0 con 0x7f0b9806ca30 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b9cace640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980b3fb0 con 0x7f0b980cd910 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b9cace640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0b980b4290 con 0x7f0b981449e0 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b95d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b980cd910 0x7f0b980cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b95d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b980cd910 0x7f0b980cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45824/0 (socket says 172.21.15.18:45824) 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.865+0000 7f0b95d9b640 1 -- 172.21.15.18:0/936150483 learned_addr learned my addr 172.21.15.18:0/936150483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:29.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.866+0000 7f0b9659c640 1 --2- 172.21.15.18:0/936150483 >> v2:172.21.15.104:3300/0 conn(0x7f0b981449e0 0x7f0b9815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.866+0000 7f0b95d9b640 1 -- 172.21.15.18:0/936150483 >> v2:172.21.15.104:3300/0 conn(0x7f0b981449e0 msgr2=0x7f0b9815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.866+0000 7f0b95d9b640 1 --2- 172.21.15.18:0/936150483 >> v2:172.21.15.104:3300/0 conn(0x7f0b981449e0 0x7f0b9815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.866+0000 7f0b95d9b640 1 -- 172.21.15.18:0/936150483 >> v1:172.21.15.104:6789/0 conn(0x7f0b9806ca30 legacy=0x7f0b9806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.866+0000 7f0b95d9b640 1 -- 172.21.15.18:0/936150483 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980b4570 con 0x7f0b980cd910 2024-04-16T12:56:29.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b95d9b640 1 --2- 172.21.15.18:0/936150483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980cd910 0x7f0b980cdda0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b98072c20 tx=0x7f0b8c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb0a59365cbbbc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9559a640 1 -- 172.21.15.18:0/936150483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c03b070 con 0x7f0b980cd910 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9559a640 1 -- 172.21.15.18:0/936150483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c036440 con 0x7f0b980cd910 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9559a640 1 -- 172.21.15.18:0/936150483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c036810 con 0x7f0b980cd910 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 -- 172.21.15.18:0/936150483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980cd910 msgr2=0x7f0b980cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 --2- 172.21.15.18:0/936150483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980cd910 0x7f0b980cdda0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b98072c20 tx=0x7f0b8c02e170 comp rx=0 tx=0).stop 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 -- 172.21.15.18:0/936150483 shutdown_connections 2024-04-16T12:56:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 --2- 172.21.15.18:0/936150483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b980cd910 0x7f0b980cdda0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 --2- 172.21.15.18:0/936150483 >> v2:172.21.15.104:3300/0 conn(0x7f0b981449e0 0x7f0b9815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 -- 172.21.15.18:0/936150483 >> 172.21.15.18:0/936150483 conn(0x7f0b98071f70 msgr2=0x7f0b98072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 -- 172.21.15.18:0/936150483 shutdown_connections 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.867+0000 7f0b9cace640 1 -- 172.21.15.18:0/936150483 wait complete. 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.869+0000 7f0b9cace640 1 Processor -- start 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.869+0000 7f0b9cace640 1 -- start start 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9806ca30 0x7f0b980aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b980cd910 0x7f0b9813c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98145240 con 0x7f0b981449e0 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980b4b30 con 0x7f0b9806ca30 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9815c230 con 0x7f0b980cd910 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45840/0 (socket says 172.21.15.18:45840) 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 -- 172.21.15.18:0/1089594093 learned_addr learned my addr 172.21.15.18:0/1089594093 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9659c640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9806ca30 0x7f0b980aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b95d9b640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b980cd910 0x7f0b9813c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 -- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b980cd910 msgr2=0x7f0b9813c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b980cd910 0x7f0b9813c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 -- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9806ca30 msgr2=0x7f0b980aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9806ca30 0x7f0b980aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 -- 172.21.15.18:0/1089594093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9813f5a0 con 0x7f0b981449e0 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b96d9d640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c7a0 tx=0x7f0b9000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90003b70 con 0x7f0b981449e0 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90003d30 con 0x7f0b981449e0 2024-04-16T12:56:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000aa90 con 0x7f0b981449e0 2024-04-16T12:56:29.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9813f880 con 0x7f0b981449e0 2024-04-16T12:56:29.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.870+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9814e070 con 0x7f0b981449e0 2024-04-16T12:56:29.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.872+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b980752b0 con 0x7f0b981449e0 2024-04-16T12:56:29.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.872+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b9000ac30 con 0x7f0b981449e0 2024-04-16T12:56:29.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.872+0000 7f0b86ffd640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 0x7f0b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.872+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f0b9008bac0 con 0x7f0b981449e0 2024-04-16T12:56:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.873+0000 7f0b9659c640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 0x7f0b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.873+0000 7f0b9659c640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 0x7f0b7806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b880079a0 tx=0x7f0b88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:29.877+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b90059710 con 0x7f0b981449e0 2024-04-16T12:56:30.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.057+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b9806efd0 con 0x7f0b7806c8f0 2024-04-16T12:56:30.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.063+0000 7f0b86ffd640 1 -- 172.21.15.18:0/1089594093 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f0b9806efd0 con 0x7f0b7806c8f0 2024-04-16T12:56:30.067 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 msgr2=0x7f0b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 0x7f0b7806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b880079a0 tx=0x7f0b88008040 comp rx=0 tx=0).stop 2024-04-16T12:56:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 msgr2=0x7f0b9813c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c7a0 tx=0x7f0b9000cc60 comp rx=0 tx=0).stop 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 shutdown_connections 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f0b7806c8f0 0x7f0b7806edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b981449e0 0x7f0b9813c680 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f0b980cd910 0x7f0b9813c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 --2- 172.21.15.18:0/1089594093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9806ca30 0x7f0b980aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 >> 172.21.15.18:0/1089594093 conn(0x7f0b98071f70 msgr2=0x7f0b9806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 shutdown_connections 2024-04-16T12:56:30.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.066+0000 7f0b9cace640 1 -- 172.21.15.18:0/1089594093 wait complete. 2024-04-16T12:56:30.079 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-16T12:56:28.538457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.313811"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:30.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.221+0000 7f38d8b59640 1 Processor -- start 2024-04-16T12:56:30.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.221+0000 7f38d8b59640 1 -- start start 2024-04-16T12:56:30.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 0x7f38d4160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 0x7f38d406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d406cf70 0x7f38d415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f38d4146280 con 0x7f38d406cf70 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f38d4145860 con 0x7f38d406f1e0 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.222+0000 7f38d8b59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f38d41611e0 con 0x7f38d4145480 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d406cf70 0x7f38d415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d406cf70 0x7f38d415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45850/0 (socket says 172.21.15.18:45850) 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 -- 172.21.15.18:0/1841295802 learned_addr learned my addr 172.21.15.18:0/1841295802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d1d9b640 1 --2- 172.21.15.18:0/1841295802 >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 0x7f38d406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d259c640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 0x7f38d4160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 -- 172.21.15.18:0/1841295802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 msgr2=0x7f38d4160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 0x7f38d4160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 -- 172.21.15.18:0/1841295802 >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 msgr2=0x7f38d406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 --2- 172.21.15.18:0/1841295802 >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 0x7f38d406ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d2d9d640 1 -- 172.21.15.18:0/1841295802 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d406e140 con 0x7f38d406cf70 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d1d9b640 1 --2- 172.21.15.18:0/1841295802 >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 0x7f38d406ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.223+0000 7f38d259c640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 0x7f38d4160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:30.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d2d9d640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406cf70 0x7f38d415cce0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f38d4073410 tx=0x7f38cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6030213d6eed7d8a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d159a640 1 -- 172.21.15.18:0/1841295802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc02ca70 con 0x7f38d406cf70 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d159a640 1 -- 172.21.15.18:0/1841295802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc02cc10 con 0x7f38d406cf70 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d159a640 1 -- 172.21.15.18:0/1841295802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0343f0 con 0x7f38d406cf70 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 -- 172.21.15.18:0/1841295802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406cf70 msgr2=0x7f38d415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406cf70 0x7f38d415cce0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f38d4073410 tx=0x7f38cc02bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 -- 172.21.15.18:0/1841295802 shutdown_connections 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 --2- 172.21.15.18:0/1841295802 >> v2:172.21.15.104:3300/0 conn(0x7f38d406f1e0 0x7f38d406ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406cf70 0x7f38d415cce0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 --2- 172.21.15.18:0/1841295802 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d4145480 0x7f38d4160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 -- 172.21.15.18:0/1841295802 >> 172.21.15.18:0/1841295802 conn(0x7f38d4071f70 msgr2=0x7f38d4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 -- 172.21.15.18:0/1841295802 shutdown_connections 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.224+0000 7f38d8b59640 1 -- 172.21.15.18:0/1841295802 wait complete. 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 Processor -- start 2024-04-16T12:56:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 -- start start 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d406cf70 0x7f38d415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38d4145480 0x7f38d41f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38d406e9e0 con 0x7f38d406f1e0 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f38d406e700 con 0x7f38d4145480 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.226+0000 7f38d8b59640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f38d406ecc0 con 0x7f38d406cf70 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45866/0 (socket says 172.21.15.18:45866) 2024-04-16T12:56:30.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 -- 172.21.15.18:0/2513670169 learned_addr learned my addr 172.21.15.18:0/2513670169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d259c640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d406cf70 0x7f38d415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d2d9d640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38d4145480 0x7f38d41f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 -- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d406cf70 msgr2=0x7f38d415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d406cf70 0x7f38d415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 -- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38d4145480 msgr2=0x7f38d41f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38d4145480 0x7f38d41f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 -- 172.21.15.18:0/2513670169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d415d690 con 0x7f38d406f1e0 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d1d9b640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c7f0 tx=0x7f38c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8015070 con 0x7f38d406f1e0 2024-04-16T12:56:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c80079d0 con 0x7f38d406f1e0 2024-04-16T12:56:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d415d970 con 0x7f38d406f1e0 2024-04-16T12:56:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8007da0 con 0x7f38d406f1e0 2024-04-16T12:56:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.227+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d415df30 con 0x7f38d406f1e0 2024-04-16T12:56:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.228+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d40752b0 con 0x7f38d406f1e0 2024-04-16T12:56:30.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.229+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38c8018070 con 0x7f38d406f1e0 2024-04-16T12:56:30.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.229+0000 7f38c2ffd640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 0x7f38b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.229+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f38c808bc10 con 0x7f38d406f1e0 2024-04-16T12:56:30.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.230+0000 7f38d259c640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 0x7f38b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.230+0000 7f38d259c640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 0x7f38b406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b20a0 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.234+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38c80597c0 con 0x7f38d406f1e0 2024-04-16T12:56:30.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.418+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38d406ca90 con 0x7f38b406c8f0 2024-04-16T12:56:30.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.425+0000 7f38c2ffd640 1 -- 172.21.15.18:0/2513670169 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f38d406ca90 con 0x7f38b406c8f0 2024-04-16T12:56:30.429 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:30.430 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:30.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 msgr2=0x7f38b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 0x7f38b406edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b20a0 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2024-04-16T12:56:30.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 msgr2=0x7f38d41f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c7f0 tx=0x7f38c800cbf0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 shutdown_connections 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f38b406c8f0 0x7f38b406edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38d4145480 0x7f38d41f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d406f1e0 0x7f38d41f1fe0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 --2- 172.21.15.18:0/2513670169 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f38d406cf70 0x7f38d415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 >> 172.21.15.18:0/2513670169 conn(0x7f38d4071f70 msgr2=0x7f38d406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 shutdown_connections 2024-04-16T12:56:30.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.428+0000 7f38d8b59640 1 -- 172.21.15.18:0/2513670169 wait complete. 2024-04-16T12:56:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-16T12:56:28.538457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.313811"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:30.445 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T12:56:30.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:30.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.583+0000 7f05af4a5640 1 Processor -- start 2024-04-16T12:56:30.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.583+0000 7f05af4a5640 1 -- start start 2024-04-16T12:56:30.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05af4a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05a815e930 0x7f05a806ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05af4a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05af4a5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a80af160 con 0x7f05a80aecb0 2024-04-16T12:56:30.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05af4a5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f05a806f550 con 0x7f05a815e930 2024-04-16T12:56:30.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05af4a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f05a80af400 con 0x7f05a806bf60 2024-04-16T12:56:30.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05ad241640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05a815e930 0x7f05a806ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05aca40640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05aca40640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:44032/0 (socket says 172.21.15.18:44032) 2024-04-16T12:56:30.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05ad241640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05a815e930 0x7f05a806ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:33656/0 (socket says 172.21.15.18:33656) 2024-04-16T12:56:30.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05aca40640 1 -- 172.21.15.18:0/508228459 learned_addr learned my addr 172.21.15.18:0/508228459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.584+0000 7f05ada42640 1 --1- 172.21.15.18:0/508228459 >> v1:172.21.15.104:6789/0 conn(0x7f05a80aecb0 0x7f05a806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:49114/0 (socket says 172.21.15.18:49114) 2024-04-16T12:56:30.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.585+0000 7f05ad241640 1 -- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 msgr2=0x7f05a80ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:30.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.585+0000 7f05ad241640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.585+0000 7f05ad241640 1 -- 172.21.15.18:0/508228459 >> v1:172.21.15.104:6789/0 conn(0x7f05a80aecb0 legacy=0x7f05a806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.585+0000 7f05ad241640 1 -- 172.21.15.18:0/508228459 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a806f770 con 0x7f05a815e930 2024-04-16T12:56:30.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.585+0000 7f05aca40640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:30.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05ad241640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a815e930 0x7f05a806ba20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009d90 tx=0x7f05a402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a636d45e1ae9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f059ffff640 1 -- 172.21.15.18:0/508228459 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4039070 con 0x7f05a815e930 2024-04-16T12:56:30.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f059ffff640 1 -- 172.21.15.18:0/508228459 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a402cc50 con 0x7f05a815e930 2024-04-16T12:56:30.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f059ffff640 1 -- 172.21.15.18:0/508228459 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4034440 con 0x7f05a815e930 2024-04-16T12:56:30.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 -- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a815e930 msgr2=0x7f05a806ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a815e930 0x7f05a806ba20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009d90 tx=0x7f05a402bea0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 -- 172.21.15.18:0/508228459 shutdown_connections 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a806bf60 0x7f05a80ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 --2- 172.21.15.18:0/508228459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a815e930 0x7f05a806ba20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.586+0000 7f05af4a5640 1 -- 172.21.15.18:0/508228459 >> 172.21.15.18:0/508228459 conn(0x7f05a80b6300 msgr2=0x7f05a809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.587+0000 7f05af4a5640 1 -- 172.21.15.18:0/508228459 shutdown_connections 2024-04-16T12:56:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.587+0000 7f05af4a5640 1 -- 172.21.15.18:0/508228459 wait complete. 2024-04-16T12:56:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 Processor -- start 2024-04-16T12:56:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 -- start start 2024-04-16T12:56:30.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a80aecb0 0x7f05a81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a81f7e30 0x7f05a8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05a80b0fa0 con 0x7f05a815e930 2024-04-16T12:56:30.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f05a80b0e20 con 0x7f05a80aecb0 2024-04-16T12:56:30.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.588+0000 7f05af4a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f05a815ed10 con 0x7f05a81f7e30 2024-04-16T12:56:30.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45868/0 (socket says 172.21.15.18:45868) 2024-04-16T12:56:30.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 -- 172.21.15.18:0/3626049871 learned_addr learned my addr 172.21.15.18:0/3626049871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05ada42640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a81f7e30 0x7f05a8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05ad241640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a80aecb0 0x7f05a81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 -- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a81f7e30 msgr2=0x7f05a8157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a81f7e30 0x7f05a8157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 -- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a80aecb0 msgr2=0x7f05a81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a80aecb0 0x7f05a81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 -- 172.21.15.18:0/3626049871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a81584a0 con 0x7f05a815e930 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05aca40640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f059800e9d0 tx=0x7f059800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598017070 con 0x7f05a815e930 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059800ca60 con 0x7f05a815e930 2024-04-16T12:56:30.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a81581c0 con 0x7f05a815e930 2024-04-16T12:56:30.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.589+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800ce10 con 0x7f05a815e930 2024-04-16T12:56:30.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.590+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a80b14a0 con 0x7f05a815e930 2024-04-16T12:56:30.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.591+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a81f8240 con 0x7f05a815e930 2024-04-16T12:56:30.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.591+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f059801a070 con 0x7f05a815e930 2024-04-16T12:56:30.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.591+0000 7f059dffb640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 0x7f058c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.591+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f059808be70 con 0x7f05a815e930 2024-04-16T12:56:30.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.592+0000 7f05ad241640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 0x7f058c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.592+0000 7f05ad241640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 0x7f058c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05a4036000 tx=0x7f05a4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.596+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05a81f8240 con 0x7f05a815e930 2024-04-16T12:56:30.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.777+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05a815f4f0 con 0x7f058c06c8f0 2024-04-16T12:56:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.783+0000 7f059dffb640 1 -- 172.21.15.18:0/3626049871 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251881 (secure 0 0 0) 0x7f05a815f4f0 con 0x7f058c06c8f0 2024-04-16T12:56:30.787 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:30.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 msgr2=0x7f058c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 0x7f058c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05a4036000 tx=0x7f05a4030000 comp rx=0 tx=0).stop 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 msgr2=0x7f05a81f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f059800e9d0 tx=0x7f059800ee90 comp rx=0 tx=0).stop 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 shutdown_connections 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f058c06c8f0 0x7f058c06edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f05a81f7e30 0x7f05a8157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815e930 0x7f05a81f78f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 --2- 172.21.15.18:0/3626049871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a80aecb0 0x7f05a81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 >> 172.21.15.18:0/3626049871 conn(0x7f05a80b6300 msgr2=0x7f05a8070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 shutdown_connections 2024-04-16T12:56:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.786+0000 7f05af4a5640 1 -- 172.21.15.18:0/3626049871 wait complete. 2024-04-16T12:56:30.799 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-16T12:56:30.538852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001698"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:30.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T12:56:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.942+0000 7f14c6a7b640 1 Processor -- start 2024-04-16T12:56:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.942+0000 7f14c6a7b640 1 -- start start 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c6a7b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f14c00b37e0 0x7f14c00d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c6a7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14c00d4370 0x7f14c006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c6a7b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00d2d90 con 0x7f14c015eca0 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c6a7b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f14c015f080 con 0x7f14c00d4370 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c6a7b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f14c00d3070 con 0x7f14c00b37e0 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14c00d4370 0x7f14c006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14c00d4370 0x7f14c006ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45870/0 (socket says 172.21.15.18:45870) 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 -- 172.21.15.18:0/1421945350 learned_addr learned my addr 172.21.15.18:0/1421945350 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14bffff640 1 --2- 172.21.15.18:0/1421945350 >> v2:172.21.15.104:3300/0 conn(0x7f14c00b37e0 0x7f14c00d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 -- 172.21.15.18:0/1421945350 >> v2:172.21.15.104:3300/0 conn(0x7f14c00b37e0 msgr2=0x7f14c00d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 --2- 172.21.15.18:0/1421945350 >> v2:172.21.15.104:3300/0 conn(0x7f14c00b37e0 0x7f14c00d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 -- 172.21.15.18:0/1421945350 >> v1:172.21.15.104:6789/0 conn(0x7f14c015eca0 legacy=0x7f14c006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.943+0000 7f14c5018640 1 -- 172.21.15.18:0/1421945350 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c00d3350 con 0x7f14c00d4370 2024-04-16T12:56:30.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.944+0000 7f14c5018640 1 --2- 172.21.15.18:0/1421945350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00d4370 0x7f14c006ce10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f14c0069180 tx=0x7f14b802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d578fea2a188dd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.944+0000 7f14bf7fe640 1 -- 172.21.15.18:0/1421945350 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b802cbb0 con 0x7f14c00d4370 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.944+0000 7f14bf7fe640 1 -- 172.21.15.18:0/1421945350 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b802cd50 con 0x7f14c00d4370 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.944+0000 7f14bf7fe640 1 -- 172.21.15.18:0/1421945350 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8034610 con 0x7f14c00d4370 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 -- 172.21.15.18:0/1421945350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00d4370 msgr2=0x7f14c006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/1421945350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00d4370 0x7f14c006ce10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f14c0069180 tx=0x7f14b802c010 comp rx=0 tx=0).stop 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 -- 172.21.15.18:0/1421945350 shutdown_connections 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/1421945350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00d4370 0x7f14c006ce10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/1421945350 >> v2:172.21.15.104:3300/0 conn(0x7f14c00b37e0 0x7f14c00d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 -- 172.21.15.18:0/1421945350 >> 172.21.15.18:0/1421945350 conn(0x7f14c00d48b0 msgr2=0x7f14c00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 -- 172.21.15.18:0/1421945350 shutdown_connections 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.945+0000 7f14c6a7b640 1 -- 172.21.15.18:0/1421945350 wait complete. 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.946+0000 7f14c6a7b640 1 Processor -- start 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.946+0000 7f14c6a7b640 1 -- start start 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 0x7f14c01e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 0x7f14c01e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14c006d350 con 0x7f14c00b37e0 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00d3910 con 0x7f14c00d4370 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c6a7b640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f14c006d4d0 con 0x7f14c015eca0 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45882/0 (socket says 172.21.15.18:45882) 2024-04-16T12:56:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 -- 172.21.15.18:0/2236050258 learned_addr learned my addr 172.21.15.18:0/2236050258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14bffff640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 0x7f14c01e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c5018640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 0x7f14c01e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 -- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 msgr2=0x7f14c01e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 0x7f14c01e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 -- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 msgr2=0x7f14c01e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 0x7f14c01e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 -- 172.21.15.18:0/2236050258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c01e73c0 con 0x7f14c00b37e0 2024-04-16T12:56:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14bffff640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 0x7f14c01e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c5018640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 0x7f14c01e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.947+0000 7f14c4817640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c3f0 tx=0x7f14b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.948+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b40052d0 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.948+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b4005490 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.948+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c01e76a0 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.948+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4007260 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.948+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c01e7c60 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.949+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c0073c80 con 0x7f14c00b37e0 2024-04-16T12:56:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.949+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14b4007400 con 0x7f14c00b37e0 2024-04-16T12:56:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.949+0000 7f14bd7fa640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.950+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f14b408b0f0 con 0x7f14c00b37e0 2024-04-16T12:56:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.950+0000 7f14bffff640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.950+0000 7f14bffff640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f14c00d01d0 tx=0x7f14ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:30.954+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14c0073c80 con 0x7f14c00b37e0 2024-04-16T12:56:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.140+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14c00752b0 con 0x7f14c00b37e0 2024-04-16T12:56:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.141+0000 7f14bd7fa640 1 -- 172.21.15.18:0/2236050258 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16942 (secure 0 0 0) 0x7f14b4059420 con 0x7f14c00b37e0 2024-04-16T12:56:31.143 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:31.143 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"fsid":"4f03925b-4efb-4ceb-afe9-e5d42c409d27","created":"2024-04-16T12:54:44.278082+0000","modified":"2024-04-16T12:56:24.231988+0000","last_up_change":"2024-04-16T12:54:55.388529+0000","last_in_change":"2024-04-16T12:54:46.526526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T12:54:54.532924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T12:56:20.273104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T12:56:21.555572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d555f91-df2f-4d04-9715-1cc07b5735e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6817","nonce":3833675534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6819","nonce":3833675534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6826","nonce":3833675534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3833675534},{"type":"v1","addr":"172.21.15.18:6822","nonce":3833675534}]},"public_addr":"172.21.15.18:6817/3833675534","cluster_addr":"172.21.15.18:6819/3833675534","heartbeat_back_addr":"172.21.15.18:6826/3833675534","heartbeat_front_addr":"172.21.15.18:6822/3833675534","state":["exists","up"]},{"osd":1,"uuid":"980098a4-db6d-4e8d-88a8-44f1c21e8c82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6801","nonce":1248885082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6803","nonce":1248885082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6807","nonce":1248885082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1248885082},{"type":"v1","addr":"172.21.15.18:6805","nonce":1248885082}]},"public_addr":"172.21.15.18:6801/1248885082","cluster_addr":"172.21.15.18:6803/1248885082","heartbeat_back_addr":"172.21.15.18:6807/1248885082","heartbeat_front_addr":"172.21.15.18:6805/1248885082","state":["exists","up"]},{"osd":2,"uuid":"dd3f633b-580f-4145-8279-9dda15232ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6821","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6823","nonce":2059210548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6825","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6827","nonce":2059210548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6831","nonce":2059210548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2059210548},{"type":"v1","addr":"172.21.15.18:6829","nonce":2059210548}]},"public_addr":"172.21.15.18:6823/2059210548","cluster_addr":"172.21.15.18:6827/2059210548","heartbeat_back_addr":"172.21.15.18:6831/2059210548","heartbeat_front_addr":"172.21.15.18:6829/2059210548","state":["exists","up"]},{"osd":3,"uuid":"4a490fbd-6e42-481b-bea5-0c7f5dd2dc3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6809","nonce":1981163326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6811","nonce":1981163326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6815","nonce":1981163326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1981163326},{"type":"v1","addr":"172.21.15.18:6813","nonce":1981163326}]},"public_addr":"172.21.15.18:6809/1981163326","cluster_addr":"172.21.15.18:6811/1981163326","heartbeat_back_addr":"172.21.15.18:6815/1981163326","heartbeat_front_addr":"172.21.15.18:6813/1981163326","state":["exists","up"]},{"osd":4,"uuid":"e659340c-01fe-42b0-84df-5e492bbe2111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6801","nonce":1931817062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6803","nonce":1931817062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6807","nonce":1931817062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":1931817062},{"type":"v1","addr":"172.21.15.104:6805","nonce":1931817062}]},"public_addr":"172.21.15.104:6801/1931817062","cluster_addr":"172.21.15.104:6803/1931817062","heartbeat_back_addr":"172.21.15.104:6807/1931817062","heartbeat_front_addr":"172.21.15.104:6805/1931817062","state":["exists","up"]},{"osd":5,"uuid":"1c6857ea-bf9a-4fc8-841e-b96992e7671d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6817","nonce":666429415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6819","nonce":666429415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6823","nonce":666429415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":666429415},{"type":"v1","addr":"172.21.15.104:6821","nonce":666429415}]},"public_addr":"172.21.15.104:6817/666429415","cluster_addr":"172.21.15.104:6819/666429415","heartbeat_back_addr":"172.21.15.104:6823/666429415","heartbeat_front_addr":"172.21.15.104:6821/666429415","state":["exists","up"]},{"osd":6,"uuid":"30376c5e-4dd9-4056-86fd-33a9aad15a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6809","nonce":3808085742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6811","nonce":3808085742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6815","nonce":3808085742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3808085742},{"type":"v1","addr":"172.21.15.104:6813","nonce":3808085742}]},"public_addr":"172.21.15.104:6809/3808085742","cluster_addr":"172.21.15.104:6811/3808085742","heartbeat_back_addr":"172.21.15.104:6815/3808085742","heartbeat_front_addr":"172.21.15.104:6813/3808085742","state":["exists","up"]},{"osd":7,"uuid":"1216dae0-820d-46ca-b883-0c8a56bba17c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6825","nonce":2122105162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6827","nonce":2122105162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6831","nonce":2122105162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2122105162},{"type":"v1","addr":"172.21.15.104:6829","nonce":2122105162}]},"public_addr":"172.21.15.104:6825/2122105162","cluster_addr":"172.21.15.104:6827/2122105162","heartbeat_back_addr":"172.21.15.104:6831/2122105162","heartbeat_front_addr":"172.21.15.104:6829/2122105162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.677927+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.662416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.765237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.704966+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.651424+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.681537+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.702871+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T12:54:51.754870+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T12:56:31.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.143+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 msgr2=0x7f14a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:31.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.143+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f14c00d01d0 tx=0x7f14ac008040 comp rx=0 tx=0).stop 2024-04-16T12:56:31.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.143+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 msgr2=0x7f14c0161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.143+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c3f0 tx=0x7f14b400c8b0 comp rx=0 tx=0).stop 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 shutdown_connections 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f14c015eca0 0x7f14c01e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14c00d4370 0x7f14c01e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 --2- 172.21.15.18:0/2236050258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14c00b37e0 0x7f14c0161600 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 >> 172.21.15.18:0/2236050258 conn(0x7f14c00d48b0 msgr2=0x7f14c00ba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:31.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 shutdown_connections 2024-04-16T12:56:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:31.144+0000 7f14c6a7b640 1 -- 172.21.15.18:0/2236050258 wait complete. 2024-04-16T12:56:32.157 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T12:56:32.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:32.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.277+0000 7f1be0dd4640 1 Processor -- start 2024-04-16T12:56:32.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.277+0000 7f1be0dd4640 1 -- start start 2024-04-16T12:56:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1be0dd4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 0x7f1bdc0d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1be0dd4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1be0dd4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bdc0b89b0 con 0x7f1bdc0b6830 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1be0dd4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1bdc0d3f30 con 0x7f1bdc0ba350 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1be0dd4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1bdc0ba790 con 0x7f1bdc15eb10 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bda59c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 0x7f1bdc0d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bdad9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1bdc0b6830 0x7f1bdc06cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:49130/0 (socket says 172.21.15.18:49130) 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:33702/0 (socket says 172.21.15.18:33702) 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 -- 172.21.15.18:0/94481376 learned_addr learned my addr 172.21.15.18:0/94481376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 -- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 msgr2=0x7f1bdc0d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 0x7f1bdc0d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 -- 172.21.15.18:0/94481376 >> v1:172.21.15.104:6789/0 conn(0x7f1bdc0b6830 legacy=0x7f1bdc06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd9d9b640 1 -- 172.21.15.18:0/94481376 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386161623 0 0) 0x7f1bdc0b89b0 con 0x7f1bdc0b6830 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bd3fff640 1 -- 172.21.15.18:0/94481376 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc0d3320 con 0x7f1bdc0ba350 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.278+0000 7f1bda59c640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 0x7f1bdc0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.279+0000 7f1bd3fff640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009870 tx=0x7f1bc402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c73bac7b20a1db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.279+0000 7f1bd9d9b640 1 -- 172.21.15.18:0/94481376 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4034070 con 0x7f1bdc0ba350 2024-04-16T12:56:32.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.279+0000 7f1bd9d9b640 1 -- 172.21.15.18:0/94481376 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc4030840 con 0x7f1bdc0ba350 2024-04-16T12:56:32.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.279+0000 7f1bd9d9b640 1 -- 172.21.15.18:0/94481376 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4030c10 con 0x7f1bdc0ba350 2024-04-16T12:56:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 -- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0ba350 msgr2=0x7f1bdc0b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009870 tx=0x7f1bc402b980 comp rx=0 tx=0).stop 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 -- 172.21.15.18:0/94481376 shutdown_connections 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0ba350 0x7f1bdc0b62f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/94481376 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc15eb10 0x7f1bdc0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 -- 172.21.15.18:0/94481376 >> 172.21.15.18:0/94481376 conn(0x7f1bdc06c0d0 msgr2=0x7f1bdc0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 -- 172.21.15.18:0/94481376 shutdown_connections 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.280+0000 7f1be0dd4640 1 -- 172.21.15.18:0/94481376 wait complete. 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.281+0000 7f1be0dd4640 1 Processor -- start 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 -- start start 2024-04-16T12:56:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0b6830 0x7f1bdc1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc0ba350 0x7f1bdc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 0x7f1bdc0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc0d3bc0 con 0x7f1bdc15eb10 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc0d38e0 con 0x7f1bdc0b6830 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1be0dd4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1bdc0d43c0 con 0x7f1bdc0ba350 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1bdad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 0x7f1bdc0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1bdad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 0x7f1bdc0cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45890/0 (socket says 172.21.15.18:45890) 2024-04-16T12:56:32.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.282+0000 7f1bdad9d640 1 -- 172.21.15.18:0/2142881286 learned_addr learned my addr 172.21.15.18:0/2142881286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bd3fff640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc0ba350 0x7f1bdc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bda59c640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0b6830 0x7f1bdc1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 -- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc0ba350 msgr2=0x7f1bdc0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1bdc0ba350 0x7f1bdc0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 -- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0b6830 msgr2=0x7f1bdc1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1bdc0b6830 0x7f1bdc1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc0cc020 con 0x7f1bdc15eb10 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bdad9d640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 0x7f1bdc0cb940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400c700 tx=0x7f1bd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4018070 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd400ce10 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400a860 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bdc0cc300 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.283+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bdc0cc8c0 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.284+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1bdc0752b0 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bd401b070 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1bd408b2f0 con 0x7f1bdc15eb10 2024-04-16T12:56:32.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f1bbc075160 0x7f1bbc0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bbc077c70 con 0x7f1bbc075160 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.285+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1bd4092050 con 0x7f1bdc15eb10 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.286+0000 7f1bda59c640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.286+0000 7f1bd3fff640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f1bbc075160 0x7f1bbc0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.286+0000 7f1bd3fff640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f1bbc075160 0x7f1bbc0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.286+0000 7f1bda59c640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009560 tx=0x7f1bcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.287+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== osd.0 v2:172.21.15.18:6816/3833675534 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bbc077c70 con 0x7f1bbc075160 2024-04-16T12:56:32.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.300+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 --> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1bdc068a70 con 0x7f1bbc075160 2024-04-16T12:56:32.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.300+0000 7f1bd2ffd640 1 -- 172.21.15.18:0/2142881286 <== osd.0 v2:172.21.15.18:6816/3833675534 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1bdc068a70 con 0x7f1bbc075160 2024-04-16T12:56:32.302 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:32.302 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:32.302 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:32.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f1bbc075160 msgr2=0x7f1bbc0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:6816/3833675534,v1:172.21.15.18:6817/3833675534] conn(0x7f1bbc075160 0x7f1bbc0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1bbc06c8f0 msgr2=0x7f1bbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009560 tx=0x7f1bcc008040 comp rx=0 tx=0).stop 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 msgr2=0x7f1bdc0cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 --2- 172.21.15.18:0/2142881286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bdc15eb10 0x7f1bdc0cb940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400c700 tx=0x7f1bd400cbc0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1bdad9d640 1 -- 172.21.15.18:0/2142881286 reap_dead start 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 shutdown_connections 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 >> 172.21.15.18:0/2142881286 conn(0x7f1bdc06c0d0 msgr2=0x7f1bdc0d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 shutdown_connections 2024-04-16T12:56:32.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.301+0000 7f1be0dd4640 1 -- 172.21.15.18:0/2142881286 wait complete. 2024-04-16T12:56:32.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T12:56:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.417+0000 7f6d527cd640 1 Processor -- start 2024-04-16T12:56:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.417+0000 7f6d527cd640 1 -- start start 2024-04-16T12:56:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d527cd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d527cd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d527cd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d4c15f0a0 con 0x7f6d4c06ce10 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d527cd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4c0d37a0 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d527cd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c0d3a80 con 0x7f6d4c0b7b20 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d43fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.418+0000 7f6d50d6a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d50d6a640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3301/0 says I am v2:172.21.15.18:44078/0 (socket says 172.21.15.18:44078) 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d43fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.18:33722/0 (socket says 172.21.15.18:33722) 2024-04-16T12:56:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d50d6a640 1 -- 172.21.15.18:0/1467222752 learned_addr learned my addr 172.21.15.18:0/1467222752 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d4bfff640 1 --1- 172.21.15.18:0/1467222752 >> v1:172.21.15.104:6789/0 conn(0x7f6d4c06ce10 0x7f6d4c06d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.18:49140/0 (socket says 172.21.15.18:49140) 2024-04-16T12:56:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d43fff640 1 -- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 msgr2=0x7f6d4c0b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d43fff640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d43fff640 1 -- 172.21.15.18:0/1467222752 >> v1:172.21.15.104:6789/0 conn(0x7f6d4c06ce10 legacy=0x7f6d4c06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d43fff640 1 -- 172.21.15.18:0/1467222752 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c0d3d60 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d4b7fe640 1 -- 172.21.15.18:0/1467222752 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448811110 0 0) 0x7f6d4c15f0a0 con 0x7f6d4c06ce10 2024-04-16T12:56:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.419+0000 7f6d50d6a640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d43fff640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d340097a0 tx=0x7f6d3402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc407de0ab29902 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d4b7fe640 1 -- 172.21.15.18:0/1467222752 <== mon.1 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34034070 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d4b7fe640 1 -- 172.21.15.18:0/1467222752 <== mon.1 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34030610 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d4b7fe640 1 -- 172.21.15.18:0/1467222752 <== mon.1 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d340309e0 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 -- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0d2ce0 msgr2=0x7f6d4c0d3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d340097a0 tx=0x7f6d3402b960 comp rx=0 tx=0).stop 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 -- 172.21.15.18:0/1467222752 shutdown_connections 2024-04-16T12:56:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0b7b20 0x7f6d4c0b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 --2- 172.21.15.18:0/1467222752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0d2ce0 0x7f6d4c0d3150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 -- 172.21.15.18:0/1467222752 >> 172.21.15.18:0/1467222752 conn(0x7f6d4c0d48d0 msgr2=0x7f6d4c0d4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.420+0000 7f6d527cd640 1 -- 172.21.15.18:0/1467222752 shutdown_connections 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.421+0000 7f6d527cd640 1 -- 172.21.15.18:0/1467222752 wait complete. 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 Processor -- start 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 -- start start 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0b7b20 0x7f6d4c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0d2ce0 0x7f6d4c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c06bc20 con 0x7f6d4c06ce10 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c0d4320 con 0x7f6d4c0b7b20 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.422+0000 7f6d527cd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c0b84b0 con 0x7f6d4c0d2ce0 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45892/0 (socket says 172.21.15.18:45892) 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 -- 172.21.15.18:0/980101742 learned_addr learned my addr 172.21.15.18:0/980101742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d43fff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0b7b20 0x7f6d4c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d50d6a640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0d2ce0 0x7f6d4c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 -- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0d2ce0 msgr2=0x7f6d4c14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0d2ce0 0x7f6d4c14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 -- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0b7b20 msgr2=0x7f6d4c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0b7b20 0x7f6d4c0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 -- 172.21.15.18:0/980101742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c15cb60 con 0x7f6d4c06ce10 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d4bfff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c4b0 tx=0x7f6d3c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c018070 con 0x7f6d4c06ce10 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c007480 con 0x7f6d4c06ce10 2024-04-16T12:56:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4c156a20 con 0x7f6d4c06ce10 2024-04-16T12:56:32.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c004820 con 0x7f6d4c06ce10 2024-04-16T12:56:32.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.423+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4c157260 con 0x7f6d4c06ce10 2024-04-16T12:56:32.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.424+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4c0752b0 con 0x7f6d4c06ce10 2024-04-16T12:56:32.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.425+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d3c01b070 con 0x7f6d4c06ce10 2024-04-16T12:56:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.425+0000 7f6d497fa640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 0x7f6d2c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.425+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6d3c08ae40 con 0x7f6d4c06ce10 2024-04-16T12:56:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.425+0000 7f6d43fff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 0x7f6d2c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.426+0000 7f6d43fff640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 0x7f6d2c06ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d34036000 tx=0x7f6d3403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.429+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d4c156a20 con 0x7f6d4c06ce10 2024-04-16T12:56:32.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.613+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6d4c157a60 con 0x7f6d2c06c920 2024-04-16T12:56:32.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.614+0000 7f6d497fa640 1 -- 172.21.15.18:0/980101742 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d4c157a60 con 0x7f6d2c06c920 2024-04-16T12:56:32.615 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 msgr2=0x7f6d2c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 0x7f6d2c06ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d34036000 tx=0x7f6d3403b040 comp rx=0 tx=0).stop 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 msgr2=0x7f6d4c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c4b0 tx=0x7f6d3c00c970 comp rx=0 tx=0).stop 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 shutdown_connections 2024-04-16T12:56:32.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6d2c06c920 0x7f6d2c06ede0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6d4c0d2ce0 0x7f6d4c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d4c0b7b20 0x7f6d4c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 --2- 172.21.15.18:0/980101742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c06ce10 0x7f6d4c15c620 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 >> 172.21.15.18:0/980101742 conn(0x7f6d4c0d48d0 msgr2=0x7f6d4c06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 shutdown_connections 2024-04-16T12:56:32.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.616+0000 7f6d527cd640 1 -- 172.21.15.18:0/980101742 wait complete. 2024-04-16T12:56:32.629 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T12:56:32.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.736+0000 7f2bca3ba640 1 Processor -- start 2024-04-16T12:56:32.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.736+0000 7f2bca3ba640 1 -- start start 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bca3ba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2bc415eb20 0x7f2bc40ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bca3ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc40cfda0 0x7f2bc40d3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bca3ba640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc4162ea0 con 0x7f2bc4162730 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bca3ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc40d2d00 con 0x7f2bc40cfda0 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bca3ba640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc4163180 con 0x7f2bc415eb20 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bc8957640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc40cfda0 0x7f2bc40d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bc8957640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc40cfda0 0x7f2bc40d3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45902/0 (socket says 172.21.15.18:45902) 2024-04-16T12:56:32.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.737+0000 7f2bc8957640 1 -- 172.21.15.18:0/541473141 learned_addr learned my addr 172.21.15.18:0/541473141 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.738+0000 7f2bc3fff640 1 --2- 172.21.15.18:0/541473141 >> v2:172.21.15.104:3300/0 conn(0x7f2bc415eb20 0x7f2bc40ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.738+0000 7f2bc8957640 1 -- 172.21.15.18:0/541473141 >> v2:172.21.15.104:3300/0 conn(0x7f2bc415eb20 msgr2=0x7f2bc40ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.738+0000 7f2bc8957640 1 --2- 172.21.15.18:0/541473141 >> v2:172.21.15.104:3300/0 conn(0x7f2bc415eb20 0x7f2bc40ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.738+0000 7f2bc8957640 1 -- 172.21.15.18:0/541473141 >> v1:172.21.15.104:6789/0 conn(0x7f2bc4162730 legacy=0x7f2bc40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.738+0000 7f2bc8957640 1 -- 172.21.15.18:0/541473141 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc4163460 con 0x7f2bc40cfda0 2024-04-16T12:56:32.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bc8957640 1 --2- 172.21.15.18:0/541473141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc40d3470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40696c0 tx=0x7f2bbc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e4ac8de26a5a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bc37fe640 1 -- 172.21.15.18:0/541473141 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc02cbb0 con 0x7f2bc40cfda0 2024-04-16T12:56:32.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bc37fe640 1 -- 172.21.15.18:0/541473141 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc02cd50 con 0x7f2bc40cfda0 2024-04-16T12:56:32.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bc37fe640 1 -- 172.21.15.18:0/541473141 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc034610 con 0x7f2bc40cfda0 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bca3ba640 1 -- 172.21.15.18:0/541473141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 msgr2=0x7f2bc40d3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.739+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/541473141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc40d3470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40696c0 tx=0x7f2bbc02c010 comp rx=0 tx=0).stop 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 -- 172.21.15.18:0/541473141 shutdown_connections 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/541473141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc40d3470 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/541473141 >> v2:172.21.15.104:3300/0 conn(0x7f2bc415eb20 0x7f2bc40ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 -- 172.21.15.18:0/541473141 >> 172.21.15.18:0/541473141 conn(0x7f2bc40b65b0 msgr2=0x7f2bc40b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 -- 172.21.15.18:0/541473141 shutdown_connections 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.740+0000 7f2bca3ba640 1 -- 172.21.15.18:0/541473141 wait complete. 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 Processor -- start 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 -- start start 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc41f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2bc415eb20 0x7f2bc4152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2bc4162730 0x7f2bc4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4162b70 con 0x7f2bc40cfda0 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc40b7a60 con 0x7f2bc4162730 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.741+0000 7f2bca3ba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc415ef00 con 0x7f2bc415eb20 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc41f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc41f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45912/0 (socket says 172.21.15.18:45912) 2024-04-16T12:56:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 -- 172.21.15.18:0/3407599457 learned_addr learned my addr 172.21.15.18:0/3407599457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc8957640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2bc4162730 0x7f2bc4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bbbfff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2bc415eb20 0x7f2bc4152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 -- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2bc415eb20 msgr2=0x7f2bc4152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f2bc415eb20 0x7f2bc4152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 -- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2bc4162730 msgr2=0x7f2bc4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2bc4162730 0x7f2bc4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc4154550 con 0x7f2bc40cfda0 2024-04-16T12:56:32.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc3fff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc41f4ee0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d830 tx=0x7f2bb400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400b6c0 con 0x7f2bc40cfda0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4019070 con 0x7f2bc40cfda0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc4154830 con 0x7f2bc40cfda0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400ba80 con 0x7f2bc40cfda0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.742+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc4154190 con 0x7f2bc40cfda0 2024-04-16T12:56:32.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.743+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bc40752b0 con 0x7f2bc40cfda0 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bb401e460 con 0x7f2bc40cfda0 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2ba406c920 0x7f2ba406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f2bb408cc60 con 0x7f2bc40cfda0 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2ba4075190 0x7f2ba40775d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ba4077ca0 con 0x7f2ba4075190 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2bb408d0f0 con 0x7f2bc40cfda0 2024-04-16T12:56:32.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.744+0000 7f2bbbfff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2ba406c920 0x7f2ba406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.745+0000 7f2bc8957640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2ba4075190 0x7f2ba40775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.745+0000 7f2bc8957640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2ba4075190 0x7f2ba40775d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.745+0000 7f2bbbfff640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2ba406c920 0x7f2ba406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bc41583b0 tx=0x7f2bac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.746+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== osd.1 v2:172.21.15.18:6800/1248885082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ba4077ca0 con 0x7f2ba4075190 2024-04-16T12:56:32.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 --> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2bc4151f10 con 0x7f2ba4075190 2024-04-16T12:56:32.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bc17fa640 1 -- 172.21.15.18:0/3407599457 <== osd.1 v2:172.21.15.18:6800/1248885082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2bc4151f10 con 0x7f2ba4075190 2024-04-16T12:56:32.761 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:32.761 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:32.761 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:32.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2ba4075190 msgr2=0x7f2ba40775d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:6800/1248885082,v1:172.21.15.18:6801/1248885082] conn(0x7f2ba4075190 0x7f2ba40775d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2ba406c920 msgr2=0x7f2ba406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f2ba406c920 0x7f2ba406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bc41583b0 tx=0x7f2bac009040 comp rx=0 tx=0).stop 2024-04-16T12:56:32.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 msgr2=0x7f2bc41f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 --2- 172.21.15.18:0/3407599457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc40cfda0 0x7f2bc41f4ee0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d830 tx=0x7f2bb400dcf0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bc8957640 1 -- 172.21.15.18:0/3407599457 reap_dead start 2024-04-16T12:56:32.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 shutdown_connections 2024-04-16T12:56:32.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 >> 172.21.15.18:0/3407599457 conn(0x7f2bc40b65b0 msgr2=0x7f2bc40d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 shutdown_connections 2024-04-16T12:56:32.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.759+0000 7f2bca3ba640 1 -- 172.21.15.18:0/3407599457 wait complete. 2024-04-16T12:56:32.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T12:56:32.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.877+0000 7f1a0ffbd640 1 Processor -- start 2024-04-16T12:56:32.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.877+0000 7f1a0ffbd640 1 -- start start 2024-04-16T12:56:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0ffbd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f1a08162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0ffbd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1a080b3d00 0x7f1a080cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0ffbd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a080b5740 con 0x7f1a080d04c0 2024-04-16T12:56:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0ffbd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0815ee10 con 0x7f1a080b3d00 2024-04-16T12:56:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0ffbd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1a080b5d50 con 0x7f1a0815ea30 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0e55a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1a080d04c0 0x7f1a080ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43446/0 (socket says 172.21.15.18:43446) 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0e55a640 1 -- 172.21.15.18:0/2546197772 learned_addr learned my addr 172.21.15.18:0/2546197772 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0dd59640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f1a08162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2546197772 >> v2:172.21.15.104:3300/0 conn(0x7f1a080b3d00 0x7f1a080cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343428253 0 0) 0x7f1a080b5740 con 0x7f1a080d04c0 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f4003520 con 0x7f1a080d04c0 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1347985982 0 0) 0x7f19f4003520 con 0x7f1a080d04c0 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 msgr2=0x7f1a08162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f1a08162ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 >> v2:172.21.15.104:3300/0 conn(0x7f1a080b3d00 msgr2=0x7f1a080cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 --2- 172.21.15.18:0/2546197772 >> v2:172.21.15.104:3300/0 conn(0x7f1a080b3d00 0x7f1a080cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08163400 con 0x7f1a080d04c0 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f1a00001670 con 0x7f1a080d04c0 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 >> v1:172.21.15.18:6789/0 conn(0x7f1a080d04c0 legacy=0x7f1a080ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f19f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4003f30 0x7f19f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.878+0000 7f1a0cd57640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19f4004d40 0x7f19f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0815ee10 con 0x7f19f4003f30 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080b5d50 con 0x7f19f4004d40 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f19f400b9c0 con 0x7f1a0815ea30 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4003f30 0x7f19f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0dd59640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f19f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0e55a640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19f4004d40 0x7f19f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 -- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 msgr2=0x7f19f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f1a0815ea30 0x7f19f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 -- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19f4004d40 msgr2=0x7f19f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19f4004d40 0x7f19f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.879+0000 7f1a0d558640 1 -- 172.21.15.18:0/2546197772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4003520 con 0x7f19f4003f30 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4003f30 0x7f19f4004800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009ac0 tx=0x7f19f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c5537ab0c53a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8039070 con 0x7f19f4003f30 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f802c6d0 con 0x7f19f4003f30 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0cd57640 1 -- 172.21.15.18:0/2546197772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8009690 con 0x7f19f4003f30 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2546197772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4003f30 msgr2=0x7f19f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2546197772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4003f30 0x7f19f4004800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009ac0 tx=0x7f19f4005830 comp rx=0 tx=0).stop 2024-04-16T12:56:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0e55a640 1 -- 172.21.15.18:0/2546197772 reap_dead start 2024-04-16T12:56:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2546197772 shutdown_connections 2024-04-16T12:56:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2546197772 >> 172.21.15.18:0/2546197772 conn(0x7f1a080d0cb0 msgr2=0x7f1a080d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2546197772 shutdown_connections 2024-04-16T12:56:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.880+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2546197772 wait complete. 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 Processor -- start 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 -- start start 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f19f4003f30 0x7f1a0815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a0815b380 0x7f1a0815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080b59e0 con 0x7f1a08144540 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080cd320 con 0x7f1a0815b380 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0ffbd640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0806ca30 con 0x7f19f4003f30 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0d558640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0d558640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45918/0 (socket says 172.21.15.18:45918) 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.882+0000 7f1a0d558640 1 -- 172.21.15.18:0/2804315669 learned_addr learned my addr 172.21.15.18:0/2804315669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0dd59640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f19f4003f30 0x7f1a0815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0e55a640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a0815b380 0x7f1a0815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 -- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f19f4003f30 msgr2=0x7f1a0815f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f19f4003f30 0x7f1a0815f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 -- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a0815b380 msgr2=0x7f1a0815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a0815b380 0x7f1a0815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 -- 172.21.15.18:0/2804315669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08160fb0 con 0x7f1a08144540 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0d558640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f19f8037040 tx=0x7f19f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8042020 con 0x7f1a08144540 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f803a040 con 0x7f1a08144540 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a08144fa0 con 0x7f1a08144540 2024-04-16T12:56:32.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8039070 con 0x7f1a08144540 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.883+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0815f1e0 con 0x7f1a08144540 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.884+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a080752b0 con 0x7f1a08144540 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.885+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19f8045020 con 0x7f1a08144540 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.885+0000 7f19fe7fc640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 0x7f19ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.885+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f19f80ad390 con 0x7f1a08144540 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.885+0000 7f1a0dd59640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 0x7f19ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.886+0000 7f1a0dd59640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 0x7f19ec06ede0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a04014430 tx=0x7f1a0400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:32.889+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19f804c030 con 0x7f1a08144540 2024-04-16T12:56:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.073+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1a080d19e0 con 0x7f19ec06c920 2024-04-16T12:56:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.074+0000 7f19fe7fc640 1 -- 172.21.15.18:0/2804315669 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a080d19e0 con 0x7f19ec06c920 2024-04-16T12:56:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 msgr2=0x7f19ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 0x7f19ec06ede0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a04014430 tx=0x7f1a0400b040 comp rx=0 tx=0).stop 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 msgr2=0x7f1a081449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f19f8037040 tx=0x7f19f8004730 comp rx=0 tx=0).stop 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 shutdown_connections 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f19ec06c920 0x7f19ec06ede0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a0815b380 0x7f1a0815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a08144540 0x7f1a081449a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 --2- 172.21.15.18:0/2804315669 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f19f4003f30 0x7f1a0815f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 >> 172.21.15.18:0/2804315669 conn(0x7f1a080d0cb0 msgr2=0x7f1a080b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 shutdown_connections 2024-04-16T12:56:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.077+0000 7f1a0ffbd640 1 -- 172.21.15.18:0/2804315669 wait complete. 2024-04-16T12:56:33.089 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T12:56:33.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.196+0000 7f5fddf04640 1 Processor -- start 2024-04-16T12:56:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.196+0000 7f5fddf04640 1 -- start start 2024-04-16T12:56:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fddf04640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5fd815eb50 0x7f5fd80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fddf04640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b47f0 0x7f5fd80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fddf04640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd80b7840 con 0x7f5fd80b6a00 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fddf04640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd80ccde0 con 0x7f5fd815eb50 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fddf04640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd80b6fa0 con 0x7f5fd80b47f0 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fd77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5fd815eb50 0x7f5fd80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fd77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5fd815eb50 0x7f5fd80b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45926/0 (socket says 172.21.15.18:45926) 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fd77fe640 1 -- 172.21.15.18:0/3858817268 learned_addr learned my addr 172.21.15.18:0/3858817268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.197+0000 7f5fd7fff640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b47f0 0x7f5fd80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd77fe640 1 -- 172.21.15.18:0/3858817268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b47f0 msgr2=0x7f5fd80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd77fe640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b47f0 0x7f5fd80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd77fe640 1 -- 172.21.15.18:0/3858817268 >> v1:172.21.15.104:6789/0 conn(0x7f5fd80b6a00 legacy=0x7f5fd80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd77fe640 1 -- 172.21.15.18:0/3858817268 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd80b7280 con 0x7f5fd815eb50 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd77fe640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b64c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ec8d66b0c229a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.198+0000 7f5fd67fc640 1 -- 172.21.15.18:0/3858817268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8034070 con 0x7f5fd815eb50 2024-04-16T12:56:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fd67fc640 1 -- 172.21.15.18:0/3858817268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc8030840 con 0x7f5fd815eb50 2024-04-16T12:56:33.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fd67fc640 1 -- 172.21.15.18:0/3858817268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8030c10 con 0x7f5fd815eb50 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 -- 172.21.15.18:0/3858817268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 msgr2=0x7f5fd80b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b64c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc802b980 comp rx=0 tx=0).stop 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 -- 172.21.15.18:0/3858817268 shutdown_connections 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b47f0 0x7f5fd80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 --2- 172.21.15.18:0/3858817268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b64c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 -- 172.21.15.18:0/3858817268 >> 172.21.15.18:0/3858817268 conn(0x7f5fd80cf0e0 msgr2=0x7f5fd80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 -- 172.21.15.18:0/3858817268 shutdown_connections 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.199+0000 7f5fddf04640 1 -- 172.21.15.18:0/3858817268 wait complete. 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.200+0000 7f5fddf04640 1 Processor -- start 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 -- start start 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fd80b47f0 0x7f5fd8153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b6a00 0x7f5fd81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd80d2370 con 0x7f5fd815eb50 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd80d21f0 con 0x7f5fd80b47f0 2024-04-16T12:56:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fddf04640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd80cd7b0 con 0x7f5fd80b6a00 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45936/0 (socket says 172.21.15.18:45936) 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.201+0000 7f5fd7fff640 1 -- 172.21.15.18:0/2220616864 learned_addr learned my addr 172.21.15.18:0/2220616864 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd6ffd640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b6a00 0x7f5fd81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd77fe640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fd80b47f0 0x7f5fd8153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 -- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b6a00 msgr2=0x7f5fd81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b6a00 0x7f5fd81549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 -- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fd80b47f0 msgr2=0x7f5fd8153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fd80b47f0 0x7f5fd8153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd806df10 con 0x7f5fd815eb50 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd6ffd640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f5fd80b6a00 0x7f5fd81549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fd7fff640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b2af0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d80 tx=0x7f5fd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0018020 con 0x7f5fd815eb50 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd0014480 con 0x7f5fd815eb50 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0014870 con 0x7f5fd815eb50 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd806e1f0 con 0x7f5fd815eb50 2024-04-16T12:56:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.202+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd806e7b0 con 0x7f5fd815eb50 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.203+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5fd8068a70 con 0x7f5fd815eb50 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.203+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fd0005d10 con 0x7f5fd815eb50 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fbffff640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fc406c8f0 0x7f5fc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f5fd008cb50 con 0x7f5fd815eb50 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fbffff640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f5fc4075160 0x7f5fc40775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fd000be50 con 0x7f5fc4075160 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5fd00912a0 con 0x7f5fd815eb50 2024-04-16T12:56:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fd77fe640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fc406c8f0 0x7f5fc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fd6ffd640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f5fc4075160 0x7f5fc40775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.204+0000 7f5fd6ffd640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f5fc4075160 0x7f5fc40775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.205+0000 7f5fd77fe640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fc406c8f0 0x7f5fc406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8036000 tx=0x7f5fc803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.205+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== osd.2 v2:172.21.15.18:6821/2059210548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5fd000be50 con 0x7f5fc4075160 2024-04-16T12:56:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.218+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 --> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5fd80ce490 con 0x7f5fc4075160 2024-04-16T12:56:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.218+0000 7f5fbffff640 1 -- 172.21.15.18:0/2220616864 <== osd.2 v2:172.21.15.18:6821/2059210548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5fd80ce490 con 0x7f5fc4075160 2024-04-16T12:56:33.220 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:33.220 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:33.220 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f5fc4075160 msgr2=0x7f5fc40775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:6821/2059210548,v1:172.21.15.18:6823/2059210548] conn(0x7f5fc4075160 0x7f5fc40775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fc406c8f0 msgr2=0x7f5fc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f5fc406c8f0 0x7f5fc406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8036000 tx=0x7f5fc803b040 comp rx=0 tx=0).stop 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 msgr2=0x7f5fd80b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 --2- 172.21.15.18:0/2220616864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd815eb50 0x7f5fd80b2af0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d80 tx=0x7f5fd000c490 comp rx=0 tx=0).stop 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fd7fff640 1 -- 172.21.15.18:0/2220616864 reap_dead start 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 shutdown_connections 2024-04-16T12:56:33.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 >> 172.21.15.18:0/2220616864 conn(0x7f5fd80cf0e0 msgr2=0x7f5fd80b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 shutdown_connections 2024-04-16T12:56:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.219+0000 7f5fddf04640 1 -- 172.21.15.18:0/2220616864 wait complete. 2024-04-16T12:56:33.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T12:56:33.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.336+0000 7fab1079d640 1 Processor -- start 2024-04-16T12:56:33.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.336+0000 7fab1079d640 1 -- start start 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab1079d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab08162630 0x7fab080cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab1079d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 0x7fab080d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab1079d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab080b7a60 con 0x7fab0815eb60 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab1079d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fab080d2f30 con 0x7fab08162630 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab1079d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fab0815ef40 con 0x7fab080cfad0 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0dd38640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab08162630 0x7fab080cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0e539640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fab0815eb60 0x7fab080ba350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43450/0 (socket says 172.21.15.18:43450) 2024-04-16T12:56:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0e539640 1 -- 172.21.15.18:0/4118628683 learned_addr learned my addr 172.21.15.18:0/4118628683 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0dd38640 1 -- 172.21.15.18:0/4118628683 >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 msgr2=0x7fab080d33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0ed3a640 1 --2- 172.21.15.18:0/4118628683 >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 0x7fab080d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0d537640 1 -- 172.21.15.18:0/4118628683 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474801309 0 0) 0x7fab04001110 con 0x7fab0815eb60 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0dd38640 1 --2- 172.21.15.18:0/4118628683 >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 0x7fab080d33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0dd38640 1 -- 172.21.15.18:0/4118628683 >> v1:172.21.15.18:6789/0 conn(0x7fab0815eb60 legacy=0x7fab080ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0dd38640 1 -- 172.21.15.18:0/4118628683 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08162a90 con 0x7fab08162630 2024-04-16T12:56:33.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.337+0000 7fab0ed3a640 1 --2- 172.21.15.18:0/4118628683 >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 0x7fab080d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.338+0000 7fab0dd38640 1 --2- 172.21.15.18:0/4118628683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab08162630 0x7fab080cf590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fab080d2060 tx=0x7faaf802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e5fec65bddad91 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.338+0000 7fab0d537640 1 -- 172.21.15.18:0/4118628683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8035020 con 0x7fab08162630 2024-04-16T12:56:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.338+0000 7fab0d537640 1 -- 172.21.15.18:0/4118628683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8031830 con 0x7fab08162630 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.338+0000 7fab0d537640 1 -- 172.21.15.18:0/4118628683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031c00 con 0x7fab08162630 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 -- 172.21.15.18:0/4118628683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab08162630 msgr2=0x7fab080cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 --2- 172.21.15.18:0/4118628683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab08162630 0x7fab080cf590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fab080d2060 tx=0x7faaf802b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 -- 172.21.15.18:0/4118628683 shutdown_connections 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 --2- 172.21.15.18:0/4118628683 >> v2:172.21.15.104:3300/0 conn(0x7fab080cfad0 0x7fab080d33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 --2- 172.21.15.18:0/4118628683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab08162630 0x7fab080cf590 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 -- 172.21.15.18:0/4118628683 >> 172.21.15.18:0/4118628683 conn(0x7fab080b65b0 msgr2=0x7fab080b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 -- 172.21.15.18:0/4118628683 shutdown_connections 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.339+0000 7fab1079d640 1 -- 172.21.15.18:0/4118628683 wait complete. 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.340+0000 7fab1079d640 1 Processor -- start 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.340+0000 7fab1079d640 1 -- start start 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab0815eb60 0x7fab08156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 0x7fab08155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab081632f0 con 0x7fab080cfad0 2024-04-16T12:56:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab08163010 con 0x7fab0815eb60 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fab080d3900 con 0x7fab08162630 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45948/0 (socket says 172.21.15.18:45948) 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 -- 172.21.15.18:0/1472831351 learned_addr learned my addr 172.21.15.18:0/1472831351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0dd38640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab0815eb60 0x7fab08156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0ed3a640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 0x7fab08155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 -- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 msgr2=0x7fab08155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 0x7fab08155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 -- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab0815eb60 msgr2=0x7fab08156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab0815eb60 0x7fab08156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 -- 172.21.15.18:0/1472831351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08158ec0 con 0x7fab080cfad0 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0ed3a640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 0x7fab08155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab0e539640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c7b0 tx=0x7fab0400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04018070 con 0x7fab080cfad0 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab040072d0 con 0x7fab080cfad0 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab081591a0 con 0x7fab080cfad0 2024-04-16T12:56:33.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.341+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab040047e0 con 0x7fab080cfad0 2024-04-16T12:56:33.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.342+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab081f9260 con 0x7fab080cfad0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.342+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab080752b0 con 0x7fab080cfad0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.343+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab0401b070 con 0x7fab080cfad0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.343+0000 7faafeffd640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 0x7faaec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.343+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fab0408afb0 con 0x7fab080cfad0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.344+0000 7fab0dd38640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 0x7faaec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.344+0000 7fab0dd38640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 0x7faaec06edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faaf8036000 tx=0x7faaf803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.348+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab080b7a60 con 0x7fab080cfad0 2024-04-16T12:56:33.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.532+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fab080c8480 con 0x7faaec06c8f0 2024-04-16T12:56:33.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.532+0000 7faafeffd640 1 -- 172.21.15.18:0/1472831351 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fab080c8480 con 0x7faaec06c8f0 2024-04-16T12:56:33.534 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T12:56:33.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 msgr2=0x7faaec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 0x7faaec06edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faaf8036000 tx=0x7faaf803c040 comp rx=0 tx=0).stop 2024-04-16T12:56:33.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 msgr2=0x7fab08160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c7b0 tx=0x7fab0400cc70 comp rx=0 tx=0).stop 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 shutdown_connections 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7faaec06c8f0 0x7faaec06edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fab08162630 0x7fab08155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab0815eb60 0x7fab08156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 --2- 172.21.15.18:0/1472831351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab080cfad0 0x7fab08160110 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 >> 172.21.15.18:0/1472831351 conn(0x7fab080b65b0 msgr2=0x7fab0815de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.534+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 shutdown_connections 2024-04-16T12:56:33.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.535+0000 7fab1079d640 1 -- 172.21.15.18:0/1472831351 wait complete. 2024-04-16T12:56:33.547 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T12:56:33.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.655+0000 7ff199959640 1 Processor -- start 2024-04-16T12:56:33.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.655+0000 7ff199959640 1 -- start start 2024-04-16T12:56:33.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff199959640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff19415eb20 0x7ff1940ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff199959640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff194162730 0x7ff1940cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff199959640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff194162ea0 con 0x7ff1940cfbd0 2024-04-16T12:56:33.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff199959640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff1940d2d00 con 0x7ff194162730 2024-04-16T12:56:33.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff199959640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff194163180 con 0x7ff19415eb20 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff194162730 0x7ff1940cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff194162730 0x7ff1940cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39564/0 (socket says 172.21.15.18:39564) 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 -- 172.21.15.18:0/3471388430 learned_addr learned my addr 172.21.15.18:0/3471388430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff192ffd640 1 --2- 172.21.15.18:0/3471388430 >> v2:172.21.15.104:3300/0 conn(0x7ff19415eb20 0x7ff1940ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 -- 172.21.15.18:0/3471388430 >> v2:172.21.15.104:3300/0 conn(0x7ff19415eb20 msgr2=0x7ff1940ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3471388430 >> v2:172.21.15.104:3300/0 conn(0x7ff19415eb20 0x7ff1940ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 -- 172.21.15.18:0/3471388430 >> v1:172.21.15.104:6789/0 conn(0x7ff1940cfbd0 legacy=0x7ff19406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.656+0000 7ff18bfff640 1 -- 172.21.15.18:0/3471388430 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff194163460 con 0x7ff194162730 2024-04-16T12:56:33.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3471388430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff194162730 0x7ff1940cf690 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff1940696c0 tx=0x7ff17c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eee428bfcef5f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff1927fc640 1 -- 172.21.15.18:0/3471388430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c034070 con 0x7ff194162730 2024-04-16T12:56:33.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff1927fc640 1 -- 172.21.15.18:0/3471388430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c030860 con 0x7ff194162730 2024-04-16T12:56:33.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff1927fc640 1 -- 172.21.15.18:0/3471388430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c030c30 con 0x7ff194162730 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff199959640 1 -- 172.21.15.18:0/3471388430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff194162730 msgr2=0x7ff1940cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.657+0000 7ff199959640 1 --2- 172.21.15.18:0/3471388430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff194162730 0x7ff1940cf690 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff1940696c0 tx=0x7ff17c02b9a0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 -- 172.21.15.18:0/3471388430 shutdown_connections 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 --2- 172.21.15.18:0/3471388430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff194162730 0x7ff1940cf690 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 --2- 172.21.15.18:0/3471388430 >> v2:172.21.15.104:3300/0 conn(0x7ff19415eb20 0x7ff1940ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 -- 172.21.15.18:0/3471388430 >> 172.21.15.18:0/3471388430 conn(0x7ff1940b65b0 msgr2=0x7ff1940b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 -- 172.21.15.18:0/3471388430 shutdown_connections 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.658+0000 7ff199959640 1 -- 172.21.15.18:0/3471388430 wait complete. 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 Processor -- start 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 -- start start 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 0x7ff19414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19415eb20 0x7ff19415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff194162730 0x7ff19415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff194162b70 con 0x7ff1940cfbd0 2024-04-16T12:56:33.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff1940b7a60 con 0x7ff19415eb20 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.659+0000 7ff199959640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff19415ef00 con 0x7ff194162730 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 0x7ff19414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 0x7ff19414cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39580/0 (socket says 172.21.15.18:39580) 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 -- 172.21.15.18:0/3967357035 learned_addr learned my addr 172.21.15.18:0/3967357035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19415eb20 0x7ff19415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff1937fe640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff194162730 0x7ff19415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 -- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff194162730 msgr2=0x7ff19415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff194162730 0x7ff19415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 -- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19415eb20 msgr2=0x7ff19415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19415eb20 0x7ff19415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1941f4b10 con 0x7ff1940cfbd0 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff19415eb20 0x7ff19415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff192ffd640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 0x7ff19414cde0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d800 tx=0x7ff18400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400b6c0 con 0x7ff1940cfbd0 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff184019070 con 0x7ff1940cfbd0 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19414d320 con 0x7ff1940cfbd0 2024-04-16T12:56:33.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400ba80 con 0x7ff1940cfbd0 2024-04-16T12:56:33.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.660+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff194157160 con 0x7ff1940cfbd0 2024-04-16T12:56:33.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.661+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1940752b0 con 0x7ff1940cfbd0 2024-04-16T12:56:33.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff18400bc20 con 0x7ff1940cfbd0 2024-04-16T12:56:33.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff17406c8f0 0x7ff17406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff18408c220 con 0x7ff1940cfbd0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7ff174075160 0x7ff1740775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff184016e50 con 0x7ff174075160 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff17406c8f0 0x7ff17406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff184093050 con 0x7ff1940cfbd0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.662+0000 7ff1937fe640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7ff174075160 0x7ff1740775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.663+0000 7ff1937fe640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7ff174075160 0x7ff1740775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.663+0000 7ff18bfff640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff17406c8f0 0x7ff17406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff17c036000 tx=0x7ff17c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.663+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== osd.3 v2:172.21.15.18:6808/1981163326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff184016e50 con 0x7ff174075160 2024-04-16T12:56:33.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.676+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 --> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1940ba0e0 con 0x7ff174075160 2024-04-16T12:56:33.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff190ff9640 1 -- 172.21.15.18:0/3967357035 <== osd.3 v2:172.21.15.18:6808/1981163326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1940ba0e0 con 0x7ff174075160 2024-04-16T12:56:33.678 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:33.679 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:33.679 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7ff174075160 msgr2=0x7ff1740775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:6808/1981163326,v1:172.21.15.18:6809/1981163326] conn(0x7ff174075160 0x7ff1740775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff17406c8f0 msgr2=0x7ff17406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff17406c8f0 0x7ff17406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff17c036000 tx=0x7ff17c03b040 comp rx=0 tx=0).stop 2024-04-16T12:56:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 msgr2=0x7ff19414cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 --2- 172.21.15.18:0/3967357035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1940cfbd0 0x7ff19414cde0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d800 tx=0x7ff18400dcc0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff1937fe640 1 -- 172.21.15.18:0/3967357035 reap_dead start 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 shutdown_connections 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 >> 172.21.15.18:0/3967357035 conn(0x7ff1940b65b0 msgr2=0x7ff1940cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 shutdown_connections 2024-04-16T12:56:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.677+0000 7ff199959640 1 -- 172.21.15.18:0/3967357035 wait complete. 2024-04-16T12:56:33.689 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T12:56:33.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.794+0000 7f9d3dbba640 1 Processor -- start 2024-04-16T12:56:33.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.794+0000 7f9d3dbba640 1 -- start start 2024-04-16T12:56:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d3dbba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d3815c7b0 0x7f9d3806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d3dbba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3806d390 con 0x7f9d380cfe70 2024-04-16T12:56:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d3dbba640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d380d0250 con 0x7f9d3806cf70 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d3dbba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9d3815c320 con 0x7f9d3815c7b0 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d2effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d3815c7b0 0x7f9d3806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d377fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d380cfe70 0x7f9d380cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52516/0 (socket says 172.21.15.18:52516) 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d377fe640 1 -- 172.21.15.18:0/493703643 learned_addr learned my addr 172.21.15.18:0/493703643 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d2effd640 1 -- 172.21.15.18:0/493703643 >> v1:172.21.15.104:6789/0 conn(0x7f9d3806cf70 legacy=0x7f9d380b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d2effd640 1 -- 172.21.15.18:0/493703643 >> v1:172.21.15.18:6789/0 conn(0x7f9d380cfe70 legacy=0x7f9d380cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d2effd640 1 -- 172.21.15.18:0/493703643 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d380cdcb0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.795+0000 7f9d36ffd640 1 -- 172.21.15.18:0/493703643 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160593279 0 0) 0x7f9d3806d390 con 0x7f9d380cfe70 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d2effd640 1 --2- 172.21.15.18:0/493703643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3806ca30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097a0 tx=0x7f9d2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c94ece5b84d98d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d36ffd640 1 -- 172.21.15.18:0/493703643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200315a0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d36ffd640 1 -- 172.21.15.18:0/493703643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d20037070 con 0x7f9d3815c7b0 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d36ffd640 1 -- 172.21.15.18:0/493703643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20031960 con 0x7f9d3815c7b0 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d3dbba640 1 -- 172.21.15.18:0/493703643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 msgr2=0x7f9d3806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/493703643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3806ca30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097a0 tx=0x7f9d2002b840 comp rx=0 tx=0).stop 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d3dbba640 1 -- 172.21.15.18:0/493703643 shutdown_connections 2024-04-16T12:56:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.796+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/493703643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3806ca30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.797+0000 7f9d3dbba640 1 -- 172.21.15.18:0/493703643 >> 172.21.15.18:0/493703643 conn(0x7f9d380b2940 msgr2=0x7f9d38072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.797+0000 7f9d3dbba640 1 -- 172.21.15.18:0/493703643 shutdown_connections 2024-04-16T12:56:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.797+0000 7f9d3dbba640 1 -- 172.21.15.18:0/493703643 wait complete. 2024-04-16T12:56:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.798+0000 7f9d3dbba640 1 Processor -- start 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.798+0000 7f9d3dbba640 1 -- start start 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9d3806cf70 0x7f9d3814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d380cfe70 0x7f9d3815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d380cdf90 con 0x7f9d3815c7b0 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3815bfb0 con 0x7f9d380cfe70 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3806f3c0 con 0x7f9d3806cf70 2024-04-16T12:56:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39592/0 (socket says 172.21.15.18:39592) 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 -- 172.21.15.18:0/3183153467 learned_addr learned my addr 172.21.15.18:0/3183153467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d377fe640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9d3806cf70 0x7f9d3814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d2effd640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d380cfe70 0x7f9d3815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 -- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9d3806cf70 msgr2=0x7f9d3814c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9d3806cf70 0x7f9d3814c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 -- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d380cfe70 msgr2=0x7f9d3815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d380cfe70 0x7f9d3815f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 -- 172.21.15.18:0/3183153467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3813cb80 con 0x7f9d3815c7b0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d37fff640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c780 tx=0x7f9d3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30004b60 con 0x7f9d3815c7b0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30004d00 con 0x7f9d3815c7b0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d381575e0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000aa90 con 0x7f9d3815c7b0 2024-04-16T12:56:33.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.799+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d38157ba0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.800+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d380752b0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.801+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d3000ac30 con 0x7f9d3815c7b0 2024-04-16T12:56:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.801+0000 7f9d34ff9640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 0x7f9d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.802+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9d3008bef0 con 0x7f9d3815c7b0 2024-04-16T12:56:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.802+0000 7f9d377fe640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 0x7f9d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.802+0000 7f9d377fe640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 0x7f9d1806edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.806+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d30020070 con 0x7f9d3815c7b0 2024-04-16T12:56:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.992+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9d3814cf20 con 0x7f9d1806c8f0 2024-04-16T12:56:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.992+0000 7f9d34ff9640 1 -- 172.21.15.18:0/3183153467 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9d28004c70 con 0x7f9d1806c8f0 2024-04-16T12:56:33.994 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T12:56:33.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 msgr2=0x7f9d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 0x7f9d1806edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28007d50 comp rx=0 tx=0).stop 2024-04-16T12:56:33.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 msgr2=0x7f9d3815f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:33.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c780 tx=0x7f9d3000cc40 comp rx=0 tx=0).stop 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 shutdown_connections 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f9d1806c8f0 0x7f9d1806edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d3815c7b0 0x7f9d3815f610 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d380cfe70 0x7f9d3815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 --2- 172.21.15.18:0/3183153467 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f9d3806cf70 0x7f9d3814c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 >> 172.21.15.18:0/3183153467 conn(0x7f9d380b2940 msgr2=0x7f9d3815e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 shutdown_connections 2024-04-16T12:56:33.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:33.995+0000 7f9d3dbba640 1 -- 172.21.15.18:0/3183153467 wait complete. 2024-04-16T12:56:34.007 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T12:56:34.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:34.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.115+0000 7f6fae97c640 1 Processor -- start 2024-04-16T12:56:34.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.115+0000 7f6fae97c640 1 -- start start 2024-04-16T12:56:34.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fae97c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6fa80b19d0 0x7f6fa815d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fae97c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa80b2420 con 0x7f6fa80b1e60 2024-04-16T12:56:34.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fae97c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa80b2700 con 0x7f6fa80b69a0 2024-04-16T12:56:34.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fae97c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa80b2fa0 con 0x7f6fa80b19d0 2024-04-16T12:56:34.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6facf19640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6fa80b1e60 0x7f6fa815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52518/0 (socket says 172.21.15.18:52518) 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6facf19640 1 -- 172.21.15.18:0/3941106848 learned_addr learned my addr 172.21.15.18:0/3941106848 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/3941106848 >> v2:172.21.15.104:3300/0 conn(0x7f6fa80b19d0 0x7f6fa815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144293545 0 0) 0x7f6fa80b2420 con 0x7f6fa80b1e60 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f90003520 con 0x7f6fa80b1e60 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3287541196 0 0) 0x7f6f90003520 con 0x7f6fa80b1e60 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 >> v2:172.21.15.104:3300/0 conn(0x7f6fa80b19d0 msgr2=0x7f6fa815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 --2- 172.21.15.18:0/3941106848 >> v2:172.21.15.104:3300/0 conn(0x7f6fa80b19d0 0x7f6fa815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 >> v1:172.21.15.104:6789/0 conn(0x7f6fa80b69a0 legacy=0x7f6fa80b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa80b29e0 con 0x7f6fa80b1e60 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.116+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f6fa00019f0 con 0x7f6fa80b1e60 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 >> v1:172.21.15.18:6789/0 conn(0x7f6fa80b1e60 legacy=0x7f6fa815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f900039b0 0x7f6f90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 0x7f6f90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f900051c0 0x7f6f9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa80b2fa0 con 0x7f6f90004800 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9000c160 con 0x7f6f900051c0 2024-04-16T12:56:34.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9000c360 con 0x7f6f900039b0 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 0x7f6f90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6facf19640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f900051c0 0x7f6f9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa7fff640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f900039b0 0x7f6f90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 -- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f900039b0 msgr2=0x7f6f90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f900039b0 0x7f6f90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 -- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f900051c0 msgr2=0x7f6f9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f900051c0 0x7f6f9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa77fe640 1 -- 172.21.15.18:0/3941106848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f90003520 con 0x7f6f90004800 2024-04-16T12:56:34.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6facf19640 1 -- 172.21.15.18:0/3941106848 reap_dead start 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.117+0000 7f6fa7fff640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6f900039b0 0x7f6f90003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 0x7f6f90004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009ac0 tx=0x7f6f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890fd76fb9d4acdd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c039070 con 0x7f6f90004800 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c02c6b0 con 0x7f6f90004800 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fa6ffd640 1 -- 172.21.15.18:0/3941106848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c009690 con 0x7f6f90004800 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fae97c640 1 -- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 msgr2=0x7f6f90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fae97c640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 0x7f6f90004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009ac0 tx=0x7f6f90005830 comp rx=0 tx=0).stop 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fae97c640 1 -- 172.21.15.18:0/3941106848 shutdown_connections 2024-04-16T12:56:34.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fae97c640 1 --2- 172.21.15.18:0/3941106848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f90004800 0x7f6f90004c80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.118+0000 7f6fae97c640 1 -- 172.21.15.18:0/3941106848 >> 172.21.15.18:0/3941106848 conn(0x7f6fa80b6290 msgr2=0x7f6fa809aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.119+0000 7f6fae97c640 1 -- 172.21.15.18:0/3941106848 shutdown_connections 2024-04-16T12:56:34.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.119+0000 7f6fae97c640 1 -- 172.21.15.18:0/3941106848 wait complete. 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.120+0000 7f6fae97c640 1 Processor -- start 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.120+0000 7f6fae97c640 1 -- start start 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f90004800 0x7f6fa809d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 0x7f6fa81349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fa80d0380 0x7f6fa80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa806bd30 con 0x7f6fa809f050 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa806bbb0 con 0x7f6f90004800 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa8146380 con 0x7f6fa80d0380 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 0x7f6fa81349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 0x7f6fa81349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39620/0 (socket says 172.21.15.18:39620) 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 -- 172.21.15.18:0/1381367281 learned_addr learned my addr 172.21.15.18:0/1381367281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa7fff640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f90004800 0x7f6fa809d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6facf19640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fa80d0380 0x7f6fa80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 -- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fa80d0380 msgr2=0x7f6fa80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f6fa80d0380 0x7f6fa80d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 -- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f90004800 msgr2=0x7f6fa809d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f90004800 0x7f6fa809d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa809f4d0 con 0x7f6fa809f050 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa77fe640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 0x7f6fa81349d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009be0 tx=0x7f6f9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c042020 con 0x7f6fa809f050 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9c03a040 con 0x7f6fa809f050 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa809d620 con 0x7f6fa809f050 2024-04-16T12:56:34.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c039070 con 0x7f6fa809f050 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.121+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa809dbe0 con 0x7f6fa809f050 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.122+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fa8132800 con 0x7f6fa809f050 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.123+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f9c045020 con 0x7f6fa809f050 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.123+0000 7f6fa4ff9640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9406c8f0 0x7f6f9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.123+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6f9c0ad350 con 0x7f6fa809f050 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6fa4ff9640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f6f94075160 0x7f6f940775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6fa7fff640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9406c8f0 0x7f6f9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f9c008eb0 con 0x7f6f94075160 2024-04-16T12:56:34.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6f9c0ad7e0 con 0x7f6fa809f050 2024-04-16T12:56:34.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6facf19640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f6f94075160 0x7f6f940775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6fa7fff640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9406c8f0 0x7f6f9406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fa806a180 tx=0x7f6f98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.124+0000 7f6facf19640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f6f94075160 0x7f6f940775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.125+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== osd.4 v2:172.21.15.104:6800/1931817062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f9c008eb0 con 0x7f6f94075160 2024-04-16T12:56:34.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.138+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 --> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fa8069180 con 0x7f6f94075160 2024-04-16T12:56:34.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fa4ff9640 1 -- 172.21.15.18:0/1381367281 <== osd.4 v2:172.21.15.104:6800/1931817062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fa8069180 con 0x7f6f94075160 2024-04-16T12:56:34.141 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:34.142 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:34.142 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f6f94075160 msgr2=0x7f6f940775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6800/1931817062,v1:172.21.15.104:6801/1931817062] conn(0x7f6f94075160 0x7f6f940775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9406c8f0 msgr2=0x7f6f9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f6f9406c8f0 0x7f6f9406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6fa806a180 tx=0x7f6f98009040 comp rx=0 tx=0).stop 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 msgr2=0x7f6fa81349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 --2- 172.21.15.18:0/1381367281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6fa809f050 0x7f6fa81349d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009be0 tx=0x7f6f9c004730 comp rx=0 tx=0).stop 2024-04-16T12:56:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6facf19640 1 -- 172.21.15.18:0/1381367281 reap_dead start 2024-04-16T12:56:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 shutdown_connections 2024-04-16T12:56:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 >> 172.21.15.18:0/1381367281 conn(0x7f6fa80b6290 msgr2=0x7f6fa806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 shutdown_connections 2024-04-16T12:56:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.139+0000 7f6fae97c640 1 -- 172.21.15.18:0/1381367281 wait complete. 2024-04-16T12:56:34.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T12:56:34.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.255+0000 7fcfa6ad9640 1 Processor -- start 2024-04-16T12:56:34.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.255+0000 7fcfa6ad9640 1 -- start start 2024-04-16T12:56:34.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.255+0000 7fcfa6ad9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcfa015eb60 0x7fcfa0162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcfa6ad9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcfa00ba350 0x7fcfa00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcfa6ad9640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00b7a60 con 0x7fcfa00cfad0 2024-04-16T12:56:34.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcfa6ad9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa00d2f30 con 0x7fcfa00ba350 2024-04-16T12:56:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcfa6ad9640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa015ef40 con 0x7fcfa015eb60 2024-04-16T12:56:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcfa00ba350 0x7fcfa00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcfa00ba350 0x7fcfa00cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39626/0 (socket says 172.21.15.18:39626) 2024-04-16T12:56:34.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 -- 172.21.15.18:0/3384428726 learned_addr learned my addr 172.21.15.18:0/3384428726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:34.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 -- 172.21.15.18:0/3384428726 >> v2:172.21.15.104:3300/0 conn(0x7fcfa015eb60 msgr2=0x7fcfa0162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 --2- 172.21.15.18:0/3384428726 >> v2:172.21.15.104:3300/0 conn(0x7fcfa015eb60 0x7fcfa0162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 -- 172.21.15.18:0/3384428726 >> v1:172.21.15.104:6789/0 conn(0x7fcfa00cfad0 legacy=0x7fcfa006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.256+0000 7fcf9ffff640 1 -- 172.21.15.18:0/3384428726 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa0162d30 con 0x7fcfa00ba350 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcf9ffff640 1 --2- 172.21.15.18:0/3384428726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa00cf590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006cb90 tx=0x7fcf8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed77e927012a08 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcf9f7fe640 1 -- 172.21.15.18:0/3384428726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c035020 con 0x7fcfa00ba350 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcf9f7fe640 1 -- 172.21.15.18:0/3384428726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c031870 con 0x7fcfa00ba350 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcf9f7fe640 1 -- 172.21.15.18:0/3384428726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c031c40 con 0x7fcfa00ba350 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3384428726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 msgr2=0x7fcfa00cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3384428726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa00cf590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006cb90 tx=0x7fcf8c02b910 comp rx=0 tx=0).stop 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3384428726 shutdown_connections 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3384428726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa00cf590 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3384428726 >> v2:172.21.15.104:3300/0 conn(0x7fcfa015eb60 0x7fcfa0162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.257+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3384428726 >> 172.21.15.18:0/3384428726 conn(0x7fcfa00b65b0 msgr2=0x7fcfa00b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.258+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3384428726 shutdown_connections 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.258+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3384428726 wait complete. 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.259+0000 7fcfa6ad9640 1 Processor -- start 2024-04-16T12:56:34.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.259+0000 7fcfa6ad9640 1 -- start start 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.259+0000 7fcfa6ad9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfa00cfad0 0x7fcfa00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcfa015eb60 0x7fcfa01f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa00ba7b0 con 0x7fcfa00ba350 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa01632f0 con 0x7fcfa00cfad0 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa00d43d0 con 0x7fcfa015eb60 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39636/0 (socket says 172.21.15.18:39636) 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 -- 172.21.15.18:0/3481663700 learned_addr learned my addr 172.21.15.18:0/3481663700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa5076640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcfa015eb60 0x7fcfa01f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcf9ffff640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfa00cfad0 0x7fcfa00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 -- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcfa015eb60 msgr2=0x7fcfa01f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcfa015eb60 0x7fcfa01f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 -- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfa00cfad0 msgr2=0x7fcfa00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfa00cfad0 0x7fcfa00cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 -- 172.21.15.18:0/3481663700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa01501c0 con 0x7fcfa00ba350 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa4875640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400b410 tx=0x7fcf9400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94015020 con 0x7fcfa00ba350 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf94011850 con 0x7fcfa00ba350 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa00ccf80 con 0x7fcfa00ba350 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011c40 con 0x7fcfa00ba350 2024-04-16T12:56:34.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.260+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa00cd540 con 0x7fcfa00ba350 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.262+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa00752b0 con 0x7fcfa00ba350 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.262+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf94018020 con 0x7fcfa00ba350 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.262+0000 7fcf9d7fa640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 0x7fcf8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.263+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fcf9408bbd0 con 0x7fcfa00ba350 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.263+0000 7fcf9ffff640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 0x7fcf8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.263+0000 7fcf9ffff640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 0x7fcf8406edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c036000 tx=0x7fcf8c03c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.267+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf9401f020 con 0x7fcfa00ba350 2024-04-16T12:56:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.451+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcfa00d25d0 con 0x7fcf8406c8f0 2024-04-16T12:56:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.452+0000 7fcf9d7fa640 1 -- 172.21.15.18:0/3481663700 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcfa00d25d0 con 0x7fcf8406c8f0 2024-04-16T12:56:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T12:56:34.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 msgr2=0x7fcf8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 0x7fcf8406edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c036000 tx=0x7fcf8c03c040 comp rx=0 tx=0).stop 2024-04-16T12:56:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 msgr2=0x7fcfa014fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400b410 tx=0x7fcf9400b8d0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 shutdown_connections 2024-04-16T12:56:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fcf8406c8f0 0x7fcf8406edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fcfa015eb60 0x7fcfa01f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfa00cfad0 0x7fcfa00cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 --2- 172.21.15.18:0/3481663700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfa00ba350 0x7fcfa014fc80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 >> 172.21.15.18:0/3481663700 conn(0x7fcfa00b65b0 msgr2=0x7fcfa00b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 shutdown_connections 2024-04-16T12:56:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.454+0000 7fcfa6ad9640 1 -- 172.21.15.18:0/3481663700 wait complete. 2024-04-16T12:56:34.466 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T12:56:34.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:34.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.574+0000 7efc6aa74640 1 Processor -- start 2024-04-16T12:56:34.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.574+0000 7efc6aa74640 1 -- start start 2024-04-16T12:56:34.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc6aa74640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efc64143110 0x7efc6406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc6aa74640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc6406ca30 0x7efc6406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc6aa74640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc640cf9f0 con 0x7efc64143cd0 2024-04-16T12:56:34.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc6aa74640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7efc6406d3d0 con 0x7efc64143110 2024-04-16T12:56:34.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc6aa74640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7efc640cfcd0 con 0x7efc6406ca30 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc68810640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efc64143110 0x7efc6406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc69011640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efc64143cd0 0x7efc64144150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52530/0 (socket says 172.21.15.18:52530) 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc69011640 1 -- 172.21.15.18:0/3054660808 learned_addr learned my addr 172.21.15.18:0/3054660808 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.575+0000 7efc63fff640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc6406ca30 0x7efc6406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc68810640 1 -- 172.21.15.18:0/3054660808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc6406ca30 msgr2=0x7efc6406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc68810640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc6406ca30 0x7efc6406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc68810640 1 -- 172.21.15.18:0/3054660808 >> v1:172.21.15.18:6789/0 conn(0x7efc64143cd0 legacy=0x7efc64144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc637fe640 1 -- 172.21.15.18:0/3054660808 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275615834 0 0) 0x7efc640cf9f0 con 0x7efc64143cd0 2024-04-16T12:56:34.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc68810640 1 -- 172.21.15.18:0/3054660808 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc640cffb0 con 0x7efc64143110 2024-04-16T12:56:34.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.576+0000 7efc68810640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc64143110 0x7efc6406dc50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d90 tx=0x7efc5c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2db4c392ba627e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc637fe640 1 -- 172.21.15.18:0/3054660808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c039070 con 0x7efc64143110 2024-04-16T12:56:34.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc637fe640 1 -- 172.21.15.18:0/3054660808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c02cce0 con 0x7efc64143110 2024-04-16T12:56:34.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc637fe640 1 -- 172.21.15.18:0/3054660808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c034660 con 0x7efc64143110 2024-04-16T12:56:34.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 -- 172.21.15.18:0/3054660808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc64143110 msgr2=0x7efc6406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc64143110 0x7efc6406dc50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d90 tx=0x7efc5c02bf30 comp rx=0 tx=0).stop 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 -- 172.21.15.18:0/3054660808 shutdown_connections 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc6406ca30 0x7efc6406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3054660808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc64143110 0x7efc6406dc50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 -- 172.21.15.18:0/3054660808 >> 172.21.15.18:0/3054660808 conn(0x7efc64071ed0 msgr2=0x7efc640722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 -- 172.21.15.18:0/3054660808 shutdown_connections 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.577+0000 7efc6aa74640 1 -- 172.21.15.18:0/3054660808 wait complete. 2024-04-16T12:56:34.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.578+0000 7efc6aa74640 1 Processor -- start 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.578+0000 7efc6aa74640 1 -- start start 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 0x7efc6415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc64143110 0x7efc640ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc64143cd0 0x7efc640ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc6406e190 con 0x7efc6406ca30 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efc641437b0 con 0x7efc64143cd0 2024-04-16T12:56:34.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc6aa74640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7efc640cf480 con 0x7efc64143110 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc68810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 0x7efc6415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc68810640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 0x7efc6415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39664/0 (socket says 172.21.15.18:39664) 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.579+0000 7efc68810640 1 -- 172.21.15.18:0/3680189955 learned_addr learned my addr 172.21.15.18:0/3680189955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc63fff640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc64143110 0x7efc640ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc69011640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc64143cd0 0x7efc640ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 -- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc64143110 msgr2=0x7efc640ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc64143110 0x7efc640ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 -- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc64143cd0 msgr2=0x7efc640ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc64143cd0 0x7efc640ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6415e0c0 con 0x7efc6406ca30 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc63fff640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7efc64143110 0x7efc640ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc69011640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc64143cd0 0x7efc640ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc68810640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 0x7efc6415bfd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d90 tx=0x7efc5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c039050 con 0x7efc6406ca30 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c045070 con 0x7efc6406ca30 2024-04-16T12:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6415e3a0 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c03e850 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.580+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6415e960 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.581+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc640752b0 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.581+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc5c03e9f0 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc617fa640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7efc5006c8f0 0x7efc5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efc5c0aebd0 con 0x7efc6406ca30 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc617fa640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7efc50075160 0x7efc500775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc50077c70 con 0x7efc50075160 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7efc5c0b42a0 con 0x7efc6406ca30 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc63fff640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7efc5006c8f0 0x7efc5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.582+0000 7efc69011640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7efc50075160 0x7efc500775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.583+0000 7efc63fff640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7efc5006c8f0 0x7efc5006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc64139ad0 tx=0x7efc58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.583+0000 7efc69011640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7efc50075160 0x7efc500775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.583+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== osd.5 v2:172.21.15.104:6816/666429415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc50077c70 con 0x7efc50075160 2024-04-16T12:56:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.596+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 --> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc640b0410 con 0x7efc50075160 2024-04-16T12:56:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.597+0000 7efc617fa640 1 -- 172.21.15.18:0/3680189955 <== osd.5 v2:172.21.15.104:6816/666429415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efc640b0410 con 0x7efc50075160 2024-04-16T12:56:34.599 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:34.599 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:34.599 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7efc50075160 msgr2=0x7efc500775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6816/666429415,v1:172.21.15.104:6817/666429415] conn(0x7efc50075160 0x7efc500775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7efc5006c8f0 msgr2=0x7efc5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7efc5006c8f0 0x7efc5006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc64139ad0 tx=0x7efc58008040 comp rx=0 tx=0).stop 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 msgr2=0x7efc6415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 --2- 172.21.15.18:0/3680189955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6406ca30 0x7efc6415bfd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d90 tx=0x7efc5c004a40 comp rx=0 tx=0).stop 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc69011640 1 -- 172.21.15.18:0/3680189955 reap_dead start 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 shutdown_connections 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 >> 172.21.15.18:0/3680189955 conn(0x7efc64071ed0 msgr2=0x7efc640cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 shutdown_connections 2024-04-16T12:56:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.598+0000 7efc6aa74640 1 -- 172.21.15.18:0/3680189955 wait complete. 2024-04-16T12:56:34.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T12:56:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.715+0000 7f8ca04d3640 1 Processor -- start 2024-04-16T12:56:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.715+0000 7f8ca04d3640 1 -- start start 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8ca04d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c980b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8ca04d3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c980d0250 con 0x7f8c980cfe70 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8ca04d3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c980cdcb0 con 0x7f8c9815c7b0 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8ca04d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9815c320 con 0x7f8c9806d140 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8c9e26f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c980cfe70 0x7f8c980cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52544/0 (socket says 172.21.15.18:52544) 2024-04-16T12:56:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8c9e26f640 1 -- 172.21.15.18:0/994969619 learned_addr learned my addr 172.21.15.18:0/994969619 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c980b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.716+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725239808 0 0) 0x7f8c980d0250 con 0x7f8c980cfe70 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c80005730 con 0x7f8c980cfe70 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.1 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464419207 0 0) 0x7f8c980cdcb0 con 0x7f8c9815c7b0 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c980d0250 con 0x7f8c9815c7b0 2024-04-16T12:56:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827937278 0 0) 0x7f8c80005730 con 0x7f8c980cfe70 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 msgr2=0x7f8c980b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c980b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 >> v1:172.21.15.104:6789/0 conn(0x7f8c9815c7b0 legacy=0x7f8c9806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9815bcd0 con 0x7f8c980cfe70 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f8c900019f0 con 0x7f8c980cfe70 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 >> v1:172.21.15.18:6789/0 conn(0x7f8c980cfe70 legacy=0x7f8c980cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c80005d80 0x7f8c80006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c80006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c800073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9815c320 con 0x7f8c80006f50 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000dd00 con 0x7f8c80005d80 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8000df00 con 0x7f8c9806d140 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c800073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9da6e640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c80006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9e26f640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c80005d80 0x7f8c80006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 -- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 msgr2=0x7f8c80006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c9806d140 0x7f8c80006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 -- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c80005d80 msgr2=0x7f8c80006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c80005d80 0x7f8c80006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.717+0000 7f8c9ea70640 1 -- 172.21.15.18:0/994969619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c80005730 con 0x7f8c80006f50 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.718+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c800073d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009a90 tx=0x7f8c80007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5b001e8361794e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.718+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c88039070 con 0x7f8c80006f50 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.718+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8802c680 con 0x7f8c80006f50 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.718+0000 7f8c9d26d640 1 -- 172.21.15.18:0/994969619 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c88009690 con 0x7f8c80006f50 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 -- 172.21.15.18:0/994969619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 msgr2=0x7f8c800073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/994969619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c800073d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009a90 tx=0x7f8c80007a40 comp rx=0 tx=0).stop 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8c9ea70640 1 -- 172.21.15.18:0/994969619 reap_dead start 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 -- 172.21.15.18:0/994969619 shutdown_connections 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 -- 172.21.15.18:0/994969619 >> 172.21.15.18:0/994969619 conn(0x7f8c980b2940 msgr2=0x7f8c98072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 -- 172.21.15.18:0/994969619 shutdown_connections 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.719+0000 7f8ca04d3640 1 -- 172.21.15.18:0/994969619 wait complete. 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.720+0000 7f8ca04d3640 1 Processor -- start 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.720+0000 7f8ca04d3640 1 -- start start 2024-04-16T12:56:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c98154fc0 0x7f8c980af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c980af590 0x7f8c9806e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9806f3c0 con 0x7f8c80006f50 2024-04-16T12:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c980cdf90 con 0x7f8c980af590 2024-04-16T12:56:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8ca04d3640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8c980cd920 con 0x7f8c98154fc0 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39680/0 (socket says 172.21.15.18:39680) 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 -- 172.21.15.18:0/1355197332 learned_addr learned my addr 172.21.15.18:0/1355197332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9da6e640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c98154fc0 0x7f8c980af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9ea70640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c980af590 0x7f8c9806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 -- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c98154fc0 msgr2=0x7f8c980af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c98154fc0 0x7f8c980af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 -- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c980af590 msgr2=0x7f8c9806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c980af590 0x7f8c9806e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 -- 172.21.15.18:0/1355197332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c980aec30 con 0x7f8c80006f50 2024-04-16T12:56:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.721+0000 7f8c9e26f640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c90007a20 tx=0x7f8c9000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.722+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90017020 con 0x7f8c80006f50 2024-04-16T12:56:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.722+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c900133f0 con 0x7f8c80006f50 2024-04-16T12:56:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.722+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c980afaa0 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.722+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c900019f0 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.722+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c980adef0 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.723+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c98069220 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.723+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c9001a020 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.724+0000 7f8c96ffd640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 0x7f8c8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.724+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8c9008c690 con 0x7f8c80006f50 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.724+0000 7f8c9da6e640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 0x7f8c8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.724+0000 7f8c9da6e640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 0x7f8c8406ede0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c980b0910 tx=0x7f8c8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.728+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c98069220 con 0x7f8c80006f50 2024-04-16T12:56:34.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:34.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:56:34.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.913+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f8c980752b0 con 0x7f8c8406c920 2024-04-16T12:56:34.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.914+0000 7f8c96ffd640 1 -- 172.21.15.18:0/1355197332 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8c980752b0 con 0x7f8c8406c920 2024-04-16T12:56:34.915 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 msgr2=0x7f8c8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 0x7f8c8406ede0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c980b0910 tx=0x7f8c8c009040 comp rx=0 tx=0).stop 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 msgr2=0x7f8c980ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c90007a20 tx=0x7f8c9000a6a0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 shutdown_connections 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f8c8406c920 0x7f8c8406ede0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8c980af590 0x7f8c9806e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8c98154fc0 0x7f8c980af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 --2- 172.21.15.18:0/1355197332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c80006f50 0x7f8c980ae6f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:34.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 >> 172.21.15.18:0/1355197332 conn(0x7f8c980b2940 msgr2=0x7f8c980b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:34.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 shutdown_connections 2024-04-16T12:56:34.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:34.916+0000 7f8ca04d3640 1 -- 172.21.15.18:0/1355197332 wait complete. 2024-04-16T12:56:34.929 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T12:56:34.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:35.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-04-16T12:56:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.077+0000 7f78a23d4640 1 Processor -- start 2024-04-16T12:56:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.077+0000 7f78a23d4640 1 -- start start 2024-04-16T12:56:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f78a23d4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f789c06d520 0x7f789c169630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f78a23d4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789c15eef0 con 0x7f789c15eb10 2024-04-16T12:56:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f78a23d4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789c0d3070 con 0x7f789c0d43e0 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f78a23d4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f789c0d3340 con 0x7f789c06d520 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f78a0971640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f789c06d520 0x7f789c169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f789bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f789c15eb10 0x7f789c0d2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52554/0 (socket says 172.21.15.18:52554) 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.078+0000 7f789bfff640 1 -- 172.21.15.18:0/4001004271 learned_addr learned my addr 172.21.15.18:0/4001004271 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.079+0000 7f78a0971640 1 -- 172.21.15.18:0/4001004271 >> v1:172.21.15.104:6789/0 conn(0x7f789c0d43e0 legacy=0x7f789c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.079+0000 7f78a0971640 1 -- 172.21.15.18:0/4001004271 >> v1:172.21.15.18:6789/0 conn(0x7f789c15eb10 legacy=0x7f789c0d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.079+0000 7f789affd640 1 -- 172.21.15.18:0/4001004271 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887469937 0 0) 0x7f789c15eef0 con 0x7f789c15eb10 2024-04-16T12:56:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.079+0000 7f78a0971640 1 -- 172.21.15.18:0/4001004271 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c0d3620 con 0x7f789c06d520 2024-04-16T12:56:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.079+0000 7f78a0971640 1 --2- 172.21.15.18:0/4001004271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c06d520 0x7f789c169630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7894009d90 tx=0x7f789402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12505bce6a6c6a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f789affd640 1 -- 172.21.15.18:0/4001004271 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894039070 con 0x7f789c06d520 2024-04-16T12:56:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f789affd640 1 -- 172.21.15.18:0/4001004271 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789402cc60 con 0x7f789c06d520 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f789affd640 1 -- 172.21.15.18:0/4001004271 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894034660 con 0x7f789c06d520 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 -- 172.21.15.18:0/4001004271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c06d520 msgr2=0x7f789c169630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 --2- 172.21.15.18:0/4001004271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c06d520 0x7f789c169630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7894009d90 tx=0x7f789402beb0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 -- 172.21.15.18:0/4001004271 shutdown_connections 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 --2- 172.21.15.18:0/4001004271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c06d520 0x7f789c169630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 -- 172.21.15.18:0/4001004271 >> 172.21.15.18:0/4001004271 conn(0x7f789c0d4920 msgr2=0x7f789c0d4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 -- 172.21.15.18:0/4001004271 shutdown_connections 2024-04-16T12:56:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.080+0000 7f78a23d4640 1 -- 172.21.15.18:0/4001004271 wait complete. 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.081+0000 7f78a23d4640 1 Processor -- start 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.081+0000 7f78a23d4640 1 -- start start 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789c06d520 0x7f789c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 0x7f789c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f789c15eb10 0x7f789c1f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f789c0d3ec0 con 0x7f789c0d43e0 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f789c0d3be0 con 0x7f789c06d520 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f78a23d4640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f789c0ba6f0 con 0x7f789c15eb10 2024-04-16T12:56:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f789b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 0x7f789c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f789b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 0x7f789c0c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39700/0 (socket says 172.21.15.18:39700) 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f789b7fe640 1 -- 172.21.15.18:0/55497584 learned_addr learned my addr 172.21.15.18:0/55497584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.082+0000 7f789bfff640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789c06d520 0x7f789c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f78a0971640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f789c15eb10 0x7f789c1f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 -- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f789c15eb10 msgr2=0x7f789c1f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f789c15eb10 0x7f789c1f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 -- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789c06d520 msgr2=0x7f789c0b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789c06d520 0x7f789c0b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c0c9720 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f78a0971640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f789c15eb10 0x7f789c1f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f789b7fe640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 0x7f789c0c8450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f789000c430 tx=0x7f789000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890011790 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7890017070 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789c0c8e80 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890011bb0 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.083+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789c0c9440 con 0x7f789c0d43e0 2024-04-16T12:56:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.084+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f789c0752b0 con 0x7f789c0d43e0 2024-04-16T12:56:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.084+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f789001c460 con 0x7f789c0d43e0 2024-04-16T12:56:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f7898ff9640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f788806c8f0 0x7f788806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f789008c530 con 0x7f789c0d43e0 2024-04-16T12:56:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f7898ff9640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f7888075150 0x7f7888077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7888077c60 con 0x7f7888075150 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f789008c9c0 con 0x7f789c0d43e0 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f789bfff640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f788806c8f0 0x7f788806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.085+0000 7f78a0971640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f7888075150 0x7f7888077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.086+0000 7f789bfff640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f788806c8f0 0x7f788806edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f788c000f60 tx=0x7f788c007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.086+0000 7f78a0971640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f7888075150 0x7f7888077590 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.087+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== osd.6 v2:172.21.15.104:6808/3808085742 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7888077c60 con 0x7f7888075150 2024-04-16T12:56:35.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.100+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 --> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f789c0cea20 con 0x7f7888075150 2024-04-16T12:56:35.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.100+0000 7f7898ff9640 1 -- 172.21.15.18:0/55497584 <== osd.6 v2:172.21.15.104:6808/3808085742 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f789c0cea20 con 0x7f7888075150 2024-04-16T12:56:35.102 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:35.102 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:35.103 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f7888075150 msgr2=0x7f7888077590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6808/3808085742,v1:172.21.15.104:6809/3808085742] conn(0x7f7888075150 0x7f7888077590 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f788806c8f0 msgr2=0x7f788806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f788806c8f0 0x7f788806edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f788c000f60 tx=0x7f788c007c00 comp rx=0 tx=0).stop 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 msgr2=0x7f789c0c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 --2- 172.21.15.18:0/55497584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0d43e0 0x7f789c0c8450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f789000c430 tx=0x7f789000c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a0971640 1 -- 172.21.15.18:0/55497584 reap_dead start 2024-04-16T12:56:35.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 shutdown_connections 2024-04-16T12:56:35.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 >> 172.21.15.18:0/55497584 conn(0x7f789c0d4920 msgr2=0x7f789c0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 shutdown_connections 2024-04-16T12:56:35.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.101+0000 7f78a23d4640 1 -- 172.21.15.18:0/55497584 wait complete. 2024-04-16T12:56:35.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T12:56:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.216+0000 7f366aa7e640 1 Processor -- start 2024-04-16T12:56:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f366aa7e640 1 -- start start 2024-04-16T12:56:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f366aa7e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36640af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f366aa7e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366415f750 con 0x7f366415f2d0 2024-04-16T12:56:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f366aa7e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366415b3e0 con 0x7f36640cec50 2024-04-16T12:56:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f366aa7e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f366415b6c0 con 0x7f3664072710 2024-04-16T12:56:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f3663fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f366415f2d0 0x7f3664072af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52570/0 (socket says 172.21.15.18:52570) 2024-04-16T12:56:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.217+0000 7f3663fff640 1 -- 172.21.15.18:0/910071465 learned_addr learned my addr 172.21.15.18:0/910071465 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f366881a640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36640af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988229134 0 0) 0x7f366415f750 con 0x7f366415f2d0 2024-04-16T12:56:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3654003520 con 0x7f366415f2d0 2024-04-16T12:56:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3655241016 0 0) 0x7f3654003520 con 0x7f366415f2d0 2024-04-16T12:56:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 msgr2=0x7f36640af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36640af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 >> v1:172.21.15.104:6789/0 conn(0x7f36640cec50 legacy=0x7f36640cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366415b9a0 con 0x7f366415f2d0 2024-04-16T12:56:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f3650001670 con 0x7f366415f2d0 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 >> v1:172.21.15.18:6789/0 conn(0x7f366415f2d0 legacy=0x7f3664072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3654003f20 0x7f3654004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3654004d40 0x7f36540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f366415b6c0 con 0x7f3654004d40 2024-04-16T12:56:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f365400bad0 con 0x7f3654003f20 2024-04-16T12:56:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f365400bcd0 con 0x7f3664072710 2024-04-16T12:56:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f366901b640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3654004d40 0x7f36540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f366881a640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f3663fff640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3654003f20 0x7f3654004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f366901b640 1 -- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 msgr2=0x7f36540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.218+0000 7f366901b640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3664072710 0x7f36540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f366901b640 1 -- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3654003f20 msgr2=0x7f3654004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f366901b640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3654003f20 0x7f3654004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f366901b640 1 -- 172.21.15.18:0/910071465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654003520 con 0x7f3654004d40 2024-04-16T12:56:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f366901b640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3654004d40 0x7f36540051c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f365c002010 tx=0x7f3654005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3e7cfca40803f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c039070 con 0x7f3654004d40 2024-04-16T12:56:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c02c750 con 0x7f3654004d40 2024-04-16T12:56:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.219+0000 7f36637fe640 1 -- 172.21.15.18:0/910071465 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c001be0 con 0x7f3654004d40 2024-04-16T12:56:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 -- 172.21.15.18:0/910071465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3654004d40 msgr2=0x7f36540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 --2- 172.21.15.18:0/910071465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3654004d40 0x7f36540051c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f365c002010 tx=0x7f3654005830 comp rx=0 tx=0).stop 2024-04-16T12:56:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366901b640 1 -- 172.21.15.18:0/910071465 reap_dead start 2024-04-16T12:56:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 -- 172.21.15.18:0/910071465 shutdown_connections 2024-04-16T12:56:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 -- 172.21.15.18:0/910071465 >> 172.21.15.18:0/910071465 conn(0x7f36640b2940 msgr2=0x7f3664072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 -- 172.21.15.18:0/910071465 shutdown_connections 2024-04-16T12:56:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.220+0000 7f366aa7e640 1 -- 172.21.15.18:0/910071465 wait complete. 2024-04-16T12:56:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.221+0000 7f366aa7e640 1 Processor -- start 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.221+0000 7f366aa7e640 1 -- start start 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3654004d40 0x7f3664146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3664153160 0x7f3664154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36640aff50 con 0x7f36640cf030 2024-04-16T12:56:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f366415c1a0 con 0x7f3664153160 2024-04-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366aa7e640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f3664155610 con 0x7f3654004d40 2024-04-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39710/0 (socket says 172.21.15.18:39710) 2024-04-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 -- 172.21.15.18:0/1570633045 learned_addr learned my addr 172.21.15.18:0/1570633045 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:35.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f3663fff640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3664153160 0x7f3664154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 -- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3654004d40 msgr2=0x7f3664146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3654004d40 0x7f3664146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 -- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3664153160 msgr2=0x7f3664154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3664153160 0x7f3664154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.222+0000 7f366901b640 1 -- 172.21.15.18:0/1570633045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366415a6b0 con 0x7f36640cf030 2024-04-16T12:56:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f366901b640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f365c02c1c0 tx=0x7f365c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c039040 con 0x7f36640cf030 2024-04-16T12:56:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c044070 con 0x7f36640cf030 2024-04-16T12:56:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36641f5680 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c001be0 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.223+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366415a970 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.224+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36640752b0 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.224+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f365c03c070 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.225+0000 7f36617fa640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 0x7f364806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.225+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f365c0acf40 con 0x7f36640cf030 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.225+0000 7f366881a640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 0x7f364806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.226+0000 7f366881a640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 0x7f364806ede0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3658009ab0 tx=0x7f36580095d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.229+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f365c04e020 con 0x7f36640cf030 2024-04-16T12:56:35.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.419+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f36641f5ba0 con 0x7f364806c920 2024-04-16T12:56:35.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.420+0000 7f36617fa640 1 -- 172.21.15.18:0/1570633045 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3658011900 con 0x7f364806c920 2024-04-16T12:56:35.421 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T12:56:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 msgr2=0x7f364806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 0x7f364806ede0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3658009ab0 tx=0x7f36580095d0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 msgr2=0x7f36640cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f365c02c1c0 tx=0x7f365c001630 comp rx=0 tx=0).stop 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 shutdown_connections 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f364806c920 0x7f364806ede0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36640cf030 0x7f36640cf4e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3664153160 0x7f3664154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 --2- 172.21.15.18:0/1570633045 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f3654004d40 0x7f3664146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.421+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 >> 172.21.15.18:0/1570633045 conn(0x7f36640b2940 msgr2=0x7f3664149f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.422+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 shutdown_connections 2024-04-16T12:56:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.422+0000 7f366aa7e640 1 -- 172.21.15.18:0/1570633045 wait complete. 2024-04-16T12:56:35.434 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T12:56:35.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T12:56:35.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.541+0000 7f72fb2a5640 1 Processor -- start 2024-04-16T12:56:35.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.542+0000 7f72fb2a5640 1 -- start start 2024-04-16T12:56:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.542+0000 7f72fb2a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72f40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.542+0000 7f72fb2a5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f40d00a0 con 0x7f72f406ca30 2024-04-16T12:56:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.542+0000 7f72fb2a5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f415b600 con 0x7f72f40b3620 2024-04-16T12:56:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.542+0000 7f72fb2a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f72f415b8e0 con 0x7f72f40ce570 2024-04-16T12:56:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f9041640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f72f406ca30 0x7f72f406ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52580/0 (socket says 172.21.15.18:52580) 2024-04-16T12:56:35.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f9041640 1 -- 172.21.15.18:0/1064849073 learned_addr learned my addr 172.21.15.18:0/1064849073 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:35.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f9842640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72f40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289283095 0 0) 0x7f72f40d00a0 con 0x7f72f406ca30 2024-04-16T12:56:35.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e0003520 con 0x7f72f406ca30 2024-04-16T12:56:35.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 380379668 0 0) 0x7f72e0003520 con 0x7f72f406ca30 2024-04-16T12:56:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 msgr2=0x7f72f40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72f40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 >> v1:172.21.15.104:6789/0 conn(0x7f72f40b3620 legacy=0x7f72f40cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f415bbc0 con 0x7f72f406ca30 2024-04-16T12:56:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f72f0001670 con 0x7f72f406ca30 2024-04-16T12:56:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 >> v1:172.21.15.18:6789/0 conn(0x7f72f406ca30 legacy=0x7f72f406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72e0004d40 0x7f72e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72f415b8e0 con 0x7f72e0003f60 2024-04-16T12:56:35.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72e000baa0 con 0x7f72e0004d40 2024-04-16T12:56:35.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f72e000bca0 con 0x7f72f40ce570 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f8840640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f9041640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.543+0000 7f72f9842640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72e0004d40 0x7f72e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 -- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 msgr2=0x7f72e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40ce570 0x7f72e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 -- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72e0004d40 msgr2=0x7f72e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72e0004d40 0x7f72e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 -- 172.21.15.18:0/1064849073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e0003520 con 0x7f72e0003f60 2024-04-16T12:56:35.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72f8840640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72e0004800 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f72e4001750 tx=0x7f72e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95114144eb9bad4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4001370 con 0x7f72e0003f60 2024-04-16T12:56:35.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.544+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e40052d0 con 0x7f72e0003f60 2024-04-16T12:56:35.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72ebfff640 1 -- 172.21.15.18:0/1064849073 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4003830 con 0x7f72e0003f60 2024-04-16T12:56:35.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 -- 172.21.15.18:0/1064849073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 msgr2=0x7f72e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 --2- 172.21.15.18:0/1064849073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72e0004800 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f72e4001750 tx=0x7f72e0005830 comp rx=0 tx=0).stop 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72f9842640 1 -- 172.21.15.18:0/1064849073 reap_dead start 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 -- 172.21.15.18:0/1064849073 shutdown_connections 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 -- 172.21.15.18:0/1064849073 >> 172.21.15.18:0/1064849073 conn(0x7f72f4071ed0 msgr2=0x7f72f40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 -- 172.21.15.18:0/1064849073 shutdown_connections 2024-04-16T12:56:35.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.545+0000 7f72fb2a5640 1 -- 172.21.15.18:0/1064849073 wait complete. 2024-04-16T12:56:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.546+0000 7f72fb2a5640 1 Processor -- start 2024-04-16T12:56:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.546+0000 7f72fb2a5640 1 -- start start 2024-04-16T12:56:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72f41f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72f4147f20 0x7f72f40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40b0d20 0x7f72f414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40afdc0 con 0x7f72e0003f60 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72f415c180 con 0x7f72f4147f20 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72fb2a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f72f40aff40 con 0x7f72f40b0d20 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72f9041640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72f41f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72f9041640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72f41f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39730/0 (socket says 172.21.15.18:39730) 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72f9041640 1 -- 172.21.15.18:0/199285534 learned_addr learned my addr 172.21.15.18:0/199285534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72f9842640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40b0d20 0x7f72f414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.547+0000 7f72f8840640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72f4147f20 0x7f72f40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 -- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40b0d20 msgr2=0x7f72f414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f72f40b0d20 0x7f72f414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 -- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72f4147f20 msgr2=0x7f72f40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72f4147f20 0x7f72f40b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f414b7d0 con 0x7f72e0003f60 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f8840640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72f4147f20 0x7f72f40b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72f9041640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72f41f4f50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f72f00011e0 tx=0x7f72f0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f000f960 con 0x7f72e0003f60 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0018070 con 0x7f72e0003f60 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f4158fd0 con 0x7f72e0003f60 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f000fd60 con 0x7f72e0003f60 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.548+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f4159590 con 0x7f72e0003f60 2024-04-16T12:56:35.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.549+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72f414bab0 con 0x7f72e0003f60 2024-04-16T12:56:35.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72f001d460 con 0x7f72e0003f60 2024-04-16T12:56:35.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72d806c8f0 0x7f72d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f72f008bd40 con 0x7f72e0003f60 2024-04-16T12:56:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f72d8075160 0x7f72d80775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72f000f020 con 0x7f72d8075160 2024-04-16T12:56:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f72f008e440 con 0x7f72e0003f60 2024-04-16T12:56:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.550+0000 7f72f8840640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72d806c8f0 0x7f72d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.551+0000 7f72f9842640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f72d8075160 0x7f72d80775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.551+0000 7f72f9842640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f72d8075160 0x7f72d80775a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.551+0000 7f72f8840640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72d806c8f0 0x7f72d806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72e4033000 tx=0x7f72e4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.552+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== osd.7 v2:172.21.15.104:6824/2122105162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72f000f020 con 0x7f72d8075160 2024-04-16T12:56:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.565+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 --> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72f40752b0 con 0x7f72d8075160 2024-04-16T12:56:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72e9ffb640 1 -- 172.21.15.18:0/199285534 <== osd.7 v2:172.21.15.104:6824/2122105162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72f40752b0 con 0x7f72d8075160 2024-04-16T12:56:35.574 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-16T12:56:35.574 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T12:56:35.575 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-16T12:56:35.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f72d8075160 msgr2=0x7f72d80775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6824/2122105162,v1:172.21.15.104:6825/2122105162] conn(0x7f72d8075160 0x7f72d80775a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72d806c8f0 msgr2=0x7f72d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f72d806c8f0 0x7f72d806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72e4033000 tx=0x7f72e4009030 comp rx=0 tx=0).stop 2024-04-16T12:56:35.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 msgr2=0x7f72f41f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 --2- 172.21.15.18:0/199285534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e0003f60 0x7f72f41f4f50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f72f00011e0 tx=0x7f72f0007720 comp rx=0 tx=0).stop 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72f9842640 1 -- 172.21.15.18:0/199285534 reap_dead start 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 shutdown_connections 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 >> 172.21.15.18:0/199285534 conn(0x7f72f4071ed0 msgr2=0x7f72f406fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 shutdown_connections 2024-04-16T12:56:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.566+0000 7f72fb2a5640 1 -- 172.21.15.18:0/199285534 wait complete. 2024-04-16T12:56:35.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T12:56:35.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.683+0000 7f4f1a6a5640 1 Processor -- start 2024-04-16T12:56:35.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.683+0000 7f4f1a6a5640 1 -- start start 2024-04-16T12:56:35.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f1a6a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070f70 0x7f4f1406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f1a6a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f1406cf70 0x7f4f1415d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f1a6a5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f140af2c0 con 0x7f4f14070b90 2024-04-16T12:56:35.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f1a6a5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4f140aed00 con 0x7f4f1406cf70 2024-04-16T12:56:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f1a6a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4f140aefe0 con 0x7f4f14070f70 2024-04-16T12:56:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f1406cf70 0x7f4f1415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f1406cf70 0x7f4f1415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39738/0 (socket says 172.21.15.18:39738) 2024-04-16T12:56:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 -- 172.21.15.18:0/2667990155 learned_addr learned my addr 172.21.15.18:0/2667990155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f0bfff640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070f70 0x7f4f1406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 -- 172.21.15.18:0/2667990155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070f70 msgr2=0x7f4f1406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070f70 0x7f4f1406ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 -- 172.21.15.18:0/2667990155 >> v1:172.21.15.104:6789/0 conn(0x7f4f14070b90 legacy=0x7f4f140ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.684+0000 7f4f18c42640 1 -- 172.21.15.18:0/2667990155 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1415cc20 con 0x7f4f1406cf70 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.685+0000 7f4f18c42640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f1415d420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009e50 tx=0x7f4f0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a8a85c7ce8560e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.685+0000 7f4f137fe640 1 -- 172.21.15.18:0/2667990155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c02ca70 con 0x7f4f1406cf70 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.685+0000 7f4f137fe640 1 -- 172.21.15.18:0/2667990155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c02cc10 con 0x7f4f1406cf70 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.685+0000 7f4f137fe640 1 -- 172.21.15.18:0/2667990155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0343f0 con 0x7f4f1406cf70 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2667990155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 msgr2=0x7f4f1415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f1415d420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009e50 tx=0x7f4f0c02bed0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2667990155 shutdown_connections 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f1415d420 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2667990155 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070f70 0x7f4f1406ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2667990155 >> 172.21.15.18:0/2667990155 conn(0x7f4f140727a0 msgr2=0x7f4f14072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2667990155 shutdown_connections 2024-04-16T12:56:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.686+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2667990155 wait complete. 2024-04-16T12:56:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.687+0000 7f4f1a6a5640 1 Processor -- start 2024-04-16T12:56:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.687+0000 7f4f1a6a5640 1 -- start start 2024-04-16T12:56:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070b90 0x7f4f1415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 0x7f4f14160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f140ae990 con 0x7f4f1406cf70 2024-04-16T12:56:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1415f1b0 con 0x7f4f14070f70 2024-04-16T12:56:35.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1415d960 con 0x7f4f14070b90 2024-04-16T12:56:35.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39742/0 (socket says 172.21.15.18:39742) 2024-04-16T12:56:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 -- 172.21.15.18:0/2369699097 learned_addr learned my addr 172.21.15.18:0/2369699097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f0bfff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070b90 0x7f4f1415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f18c42640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 0x7f4f14160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 -- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070b90 msgr2=0x7f4f1415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070b90 0x7f4f1415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 -- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 msgr2=0x7f4f14160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 0x7f4f14160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 -- 172.21.15.18:0/2369699097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f141f7d60 con 0x7f4f1406cf70 2024-04-16T12:56:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f18c42640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 0x7f4f14160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f13fff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c430 tx=0x7f4f0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04011790 con 0x7f4f1406cf70 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f04017070 con 0x7f4f1406cf70 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f141f8040 con 0x7f4f1406cf70 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04011bb0 con 0x7f4f1406cf70 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.688+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f14153dd0 con 0x7f4f1406cf70 2024-04-16T12:56:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.689+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f14068a70 con 0x7f4f1406cf70 2024-04-16T12:56:35.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.690+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f0401c460 con 0x7f4f1406cf70 2024-04-16T12:56:35.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.690+0000 7f4f117fa640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 0x7f4ef406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:35.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.690+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4f0408bc00 con 0x7f4f1406cf70 2024-04-16T12:56:35.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.691+0000 7f4f0bfff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 0x7f4ef406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.691+0000 7f4f0bfff640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 0x7f4ef406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4efc006fd0 tx=0x7f4efc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.695+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f04092080 con 0x7f4f1406cf70 2024-04-16T12:56:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.881+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4f140738c0 con 0x7f4ef406c8f0 2024-04-16T12:56:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.882+0000 7f4f117fa640 1 -- 172.21.15.18:0/2369699097 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f140738c0 con 0x7f4ef406c8f0 2024-04-16T12:56:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T12:56:35.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 msgr2=0x7f4ef406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 0x7f4ef406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4efc006fd0 tx=0x7f4efc008040 comp rx=0 tx=0).stop 2024-04-16T12:56:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 msgr2=0x7f4f14153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c430 tx=0x7f4f0400c8f0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 shutdown_connections 2024-04-16T12:56:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4ef406c8f0 0x7f4ef406edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f14070f70 0x7f4f14160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4f14070b90 0x7f4f1415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 --2- 172.21.15.18:0/2369699097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f1406cf70 0x7f4f14153890 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 >> 172.21.15.18:0/2369699097 conn(0x7f4f140727a0 msgr2=0x7f4f14160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 shutdown_connections 2024-04-16T12:56:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:35.884+0000 7f4f1a6a5640 1 -- 172.21.15.18:0/2369699097 wait complete. 2024-04-16T12:56:35.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:36.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.001+0000 7fe95a532640 1 Processor -- start 2024-04-16T12:56:36.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.001+0000 7fe95a532640 1 -- start start 2024-04-16T12:56:36.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe95a532640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe9540b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe95a532640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95406c6c0 con 0x7fe95406d520 2024-04-16T12:56:36.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe95a532640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9540d2db0 con 0x7fe954162240 2024-04-16T12:56:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe95a532640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe95406c9a0 con 0x7fe95406c130 2024-04-16T12:56:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe94bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe95406d520 0x7fe95406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52596/0 (socket says 172.21.15.18:52596) 2024-04-16T12:56:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.002+0000 7fe94bfff640 1 -- 172.21.15.18:0/2151367536 learned_addr learned my addr 172.21.15.18:0/2151367536 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141932936 0 0) 0x7fe95406c6c0 con 0x7fe95406d520 2024-04-16T12:56:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe940003520 con 0x7fe95406d520 2024-04-16T12:56:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe958acf640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe9540b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350189264 0 0) 0x7fe940003520 con 0x7fe95406d520 2024-04-16T12:56:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 msgr2=0x7fe9540b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe9540b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 >> v1:172.21.15.104:6789/0 conn(0x7fe954162240 legacy=0x7fe95406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540d3090 con 0x7fe95406d520 2024-04-16T12:56:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7fe93c001670 con 0x7fe95406d520 2024-04-16T12:56:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 >> v1:172.21.15.18:6789/0 conn(0x7fe95406d520 legacy=0x7fe95406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9400039e0 0x7fe940003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe940004800 0x7fe940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe940005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe95406c9a0 con 0x7fe9400039e0 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe94000bb20 con 0x7fe940004800 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe94000bd20 con 0x7fe95406c130 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9400039e0 0x7fe940003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe94bfff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe940004800 0x7fe940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe958acf640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe940005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 -- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 msgr2=0x7fe940005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe940005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 -- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe940004800 msgr2=0x7fe940004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe940004800 0x7fe940004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe953fff640 1 -- 172.21.15.18:0/2151367536 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe940003520 con 0x7fe9400039e0 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe94bfff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe940004800 0x7fe940004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.003+0000 7fe958acf640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe95406c130 0x7fe940005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.004+0000 7fe953fff640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9400039e0 0x7fe940003e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe944001750 tx=0x7fe940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c07ee0a294f609 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.004+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944001370 con 0x7fe9400039e0 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.004+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440052d0 con 0x7fe9400039e0 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.004+0000 7fe9537fe640 1 -- 172.21.15.18:0/2151367536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944003830 con 0x7fe9400039e0 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 -- 172.21.15.18:0/2151367536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9400039e0 msgr2=0x7fe940003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 --2- 172.21.15.18:0/2151367536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9400039e0 0x7fe940003e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe944001750 tx=0x7fe940005830 comp rx=0 tx=0).stop 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe958acf640 1 -- 172.21.15.18:0/2151367536 reap_dead start 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 -- 172.21.15.18:0/2151367536 shutdown_connections 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 -- 172.21.15.18:0/2151367536 >> 172.21.15.18:0/2151367536 conn(0x7fe9540d48b0 msgr2=0x7fe9540d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 -- 172.21.15.18:0/2151367536 shutdown_connections 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.005+0000 7fe95a532640 1 -- 172.21.15.18:0/2151367536 wait complete. 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.006+0000 7fe95a532640 1 Processor -- start 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.006+0000 7fe95a532640 1 -- start start 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9400039e0 0x7fe954153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9541544c0 0x7fe954151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540b7ed0 con 0x7fe9541524c0 2024-04-16T12:56:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9540b7d50 con 0x7fe9541544c0 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe95a532640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7fe9540d3890 con 0x7fe9400039e0 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39768/0 (socket says 172.21.15.18:39768) 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 -- 172.21.15.18:0/1381178863 learned_addr learned my addr 172.21.15.18:0/1381178863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe94bfff640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9541544c0 0x7fe954151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe953fff640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9400039e0 0x7fe954153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 -- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9400039e0 msgr2=0x7fe954153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9400039e0 0x7fe954153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 -- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9541544c0 msgr2=0x7fe954151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9541544c0 0x7fe954151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 -- 172.21.15.18:0/1381178863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe954160e60 con 0x7fe9541524c0 2024-04-16T12:56:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.007+0000 7fe958acf640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe9540d5950 tx=0x7fe94c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.008+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c01a030 con 0x7fe9541524c0 2024-04-16T12:56:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.008+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c010e50 con 0x7fe9541524c0 2024-04-16T12:56:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.008+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe954150ee0 con 0x7fe9541524c0 2024-04-16T12:56:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.008+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c003bd0 con 0x7fe9541524c0 2024-04-16T12:56:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.008+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9541514a0 con 0x7fe9541524c0 2024-04-16T12:56:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.009+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9540752b0 con 0x7fe9541524c0 2024-04-16T12:56:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.009+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe94c005d10 con 0x7fe9541524c0 2024-04-16T12:56:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.010+0000 7fe9517fa640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 0x7fe93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.010+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe94c08c1f0 con 0x7fe9541524c0 2024-04-16T12:56:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.010+0000 7fe953fff640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 0x7fe93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.010+0000 7fe953fff640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 0x7fe93406edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe944033000 tx=0x7fe944009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.014+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe94c025020 con 0x7fe9541524c0 2024-04-16T12:56:36.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.199+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9541507e0 con 0x7fe93406c8f0 2024-04-16T12:56:36.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.206+0000 7fe9517fa640 1 -- 172.21.15.18:0/1381178863 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251847 (secure 0 0 0) 0x7fe9541507e0 con 0x7fe93406c8f0 2024-04-16T12:56:36.211 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:36.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 msgr2=0x7fe93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 0x7fe93406edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe944033000 tx=0x7fe944009030 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 msgr2=0x7fe9540cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe9540d5950 tx=0x7fe94c009f90 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 shutdown_connections 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7fe93406c8f0 0x7fe93406edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9541524c0 0x7fe9540cf480 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9541544c0 0x7fe954151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 --2- 172.21.15.18:0/1381178863 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7fe9400039e0 0x7fe954153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 >> 172.21.15.18:0/1381178863 conn(0x7fe9540d48b0 msgr2=0x7fe9540d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:36.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 shutdown_connections 2024-04-16T12:56:36.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:36.209+0000 7fe95a532640 1 -- 172.21.15.18:0/1381178863 wait complete. 2024-04-16T12:56:36.221 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-16T12:56:34.539725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237444,"kb_used_data":4616,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737276,"statfs":{"total":773094113280,"available":772850970624,"internally_reserved":0,"allocated":4726784,"data_stored":2698996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.301083"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701387+0000","last_change":"2024-04-16T12:56:23.251656+0000","last_active":"2024-04-16T12:56:24.701387+0000","last_peered":"2024-04-16T12:56:24.701387+0000","last_clean":"2024-04-16T12:56:24.701387+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:24.701387+0000","last_undegraded":"2024-04-16T12:56:24.701387+0000","last_fullsized":"2024-04-16T12:56:24.701387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701247+0000","last_change":"2024-04-16T12:56:23.243367+0000","last_active":"2024-04-16T12:56:24.701247+0000","last_peered":"2024-04-16T12:56:24.701247+0000","last_clean":"2024-04-16T12:56:24.701247+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:24.701247+0000","last_undegraded":"2024-04-16T12:56:24.701247+0000","last_fullsized":"2024-04-16T12:56:24.701247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773542+0000","last_change":"2024-04-16T12:56:23.245725+0000","last_active":"2024-04-16T12:56:24.773542+0000","last_peered":"2024-04-16T12:56:24.773542+0000","last_clean":"2024-04-16T12:56:24.773542+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:24.773542+0000","last_undegraded":"2024-04-16T12:56:24.773542+0000","last_fullsized":"2024-04-16T12:56:24.773542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235190+0000","last_change":"2024-04-16T12:56:23.263619+0000","last_active":"2024-04-16T12:56:24.235190+0000","last_peered":"2024-04-16T12:56:24.235190+0000","last_clean":"2024-04-16T12:56:24.235190+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:24.235190+0000","last_undegraded":"2024-04-16T12:56:24.235190+0000","last_fullsized":"2024-04-16T12:56:24.235190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:06.497176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234910+0000","last_change":"2024-04-16T12:56:23.252596+0000","last_active":"2024-04-16T12:56:24.234910+0000","last_peered":"2024-04-16T12:56:24.234910+0000","last_clean":"2024-04-16T12:56:24.234910+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:24.234910+0000","last_undegraded":"2024-04-16T12:56:24.234910+0000","last_fullsized":"2024-04-16T12:56:24.234910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:30.401085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272969+0000","last_change":"2024-04-16T12:56:23.253455+0000","last_active":"2024-04-16T12:56:24.272969+0000","last_peered":"2024-04-16T12:56:24.272969+0000","last_clean":"2024-04-16T12:56:24.272969+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:24.272969+0000","last_undegraded":"2024-04-16T12:56:24.272969+0000","last_fullsized":"2024-04-16T12:56:24.272969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774391+0000","last_change":"2024-04-16T12:56:23.243809+0000","last_active":"2024-04-16T12:56:24.774391+0000","last_peered":"2024-04-16T12:56:24.774391+0000","last_clean":"2024-04-16T12:56:24.774391+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:24.774391+0000","last_undegraded":"2024-04-16T12:56:24.774391+0000","last_fullsized":"2024-04-16T12:56:24.774391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700940+0000","last_change":"2024-04-16T12:56:23.255864+0000","last_active":"2024-04-16T12:56:24.700940+0000","last_peered":"2024-04-16T12:56:24.700940+0000","last_clean":"2024-04-16T12:56:24.700940+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:24.700940+0000","last_undegraded":"2024-04-16T12:56:24.700940+0000","last_fullsized":"2024-04-16T12:56:24.700940+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773706+0000","last_change":"2024-04-16T12:56:23.244906+0000","last_active":"2024-04-16T12:56:24.773706+0000","last_peered":"2024-04-16T12:56:24.773706+0000","last_clean":"2024-04-16T12:56:24.773706+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:24.773706+0000","last_undegraded":"2024-04-16T12:56:24.773706+0000","last_fullsized":"2024-04-16T12:56:24.773706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775204+0000","last_change":"2024-04-16T12:56:23.254050+0000","last_active":"2024-04-16T12:56:24.775204+0000","last_peered":"2024-04-16T12:56:24.775204+0000","last_clean":"2024-04-16T12:56:24.775204+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:24.775204+0000","last_undegraded":"2024-04-16T12:56:24.775204+0000","last_fullsized":"2024-04-16T12:56:24.775204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775216+0000","last_change":"2024-04-16T12:56:23.253257+0000","last_active":"2024-04-16T12:56:24.775216+0000","last_peered":"2024-04-16T12:56:24.775216+0000","last_clean":"2024-04-16T12:56:24.775216+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:24.775216+0000","last_undegraded":"2024-04-16T12:56:24.775216+0000","last_fullsized":"2024-04-16T12:56:24.775216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:19.527260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773580+0000","last_change":"2024-04-16T12:56:23.238569+0000","last_active":"2024-04-16T12:56:24.773580+0000","last_peered":"2024-04-16T12:56:24.773580+0000","last_clean":"2024-04-16T12:56:24.773580+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:24.773580+0000","last_undegraded":"2024-04-16T12:56:24.773580+0000","last_fullsized":"2024-04-16T12:56:24.773580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774315+0000","last_change":"2024-04-16T12:56:23.256515+0000","last_active":"2024-04-16T12:56:24.774315+0000","last_peered":"2024-04-16T12:56:24.774315+0000","last_clean":"2024-04-16T12:56:24.774315+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:24.774315+0000","last_undegraded":"2024-04-16T12:56:24.774315+0000","last_fullsized":"2024-04-16T12:56:24.774315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240460+0000","last_change":"2024-04-16T12:56:23.263337+0000","last_active":"2024-04-16T12:56:24.240460+0000","last_peered":"2024-04-16T12:56:24.240460+0000","last_clean":"2024-04-16T12:56:24.240460+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:24.240460+0000","last_undegraded":"2024-04-16T12:56:24.240460+0000","last_fullsized":"2024-04-16T12:56:24.240460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774545+0000","last_change":"2024-04-16T12:56:23.241198+0000","last_active":"2024-04-16T12:56:24.774545+0000","last_peered":"2024-04-16T12:56:24.774545+0000","last_clean":"2024-04-16T12:56:24.774545+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:24.774545+0000","last_undegraded":"2024-04-16T12:56:24.774545+0000","last_fullsized":"2024-04-16T12:56:24.774545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773997+0000","last_change":"2024-04-16T12:56:23.258601+0000","last_active":"2024-04-16T12:56:24.773997+0000","last_peered":"2024-04-16T12:56:24.773997+0000","last_clean":"2024-04-16T12:56:24.773997+0000","last_became_active":"2024-04-16T12:56:23.258329+0000","last_became_peered":"2024-04-16T12:56:23.258329+0000","last_unstale":"2024-04-16T12:56:24.773997+0000","last_undegraded":"2024-04-16T12:56:24.773997+0000","last_fullsized":"2024-04-16T12:56:24.773997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:31.373508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774754+0000","last_change":"2024-04-16T12:56:23.260906+0000","last_active":"2024-04-16T12:56:24.774754+0000","last_peered":"2024-04-16T12:56:24.774754+0000","last_clean":"2024-04-16T12:56:24.774754+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:24.774754+0000","last_undegraded":"2024-04-16T12:56:24.774754+0000","last_fullsized":"2024-04-16T12:56:24.774754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239903+0000","last_change":"2024-04-16T12:56:23.252509+0000","last_active":"2024-04-16T12:56:24.239903+0000","last_peered":"2024-04-16T12:56:24.239903+0000","last_clean":"2024-04-16T12:56:24.239903+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:24.239903+0000","last_undegraded":"2024-04-16T12:56:24.239903+0000","last_fullsized":"2024-04-16T12:56:24.239903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235198+0000","last_change":"2024-04-16T12:56:23.253173+0000","last_active":"2024-04-16T12:56:24.235198+0000","last_peered":"2024-04-16T12:56:24.235198+0000","last_clean":"2024-04-16T12:56:24.235198+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:24.235198+0000","last_undegraded":"2024-04-16T12:56:24.235198+0000","last_fullsized":"2024-04-16T12:56:24.235198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:04.632453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239946+0000","last_change":"2024-04-16T12:56:23.264681+0000","last_active":"2024-04-16T12:56:24.239946+0000","last_peered":"2024-04-16T12:56:24.239946+0000","last_clean":"2024-04-16T12:56:24.239946+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:24.239946+0000","last_undegraded":"2024-04-16T12:56:24.239946+0000","last_fullsized":"2024-04-16T12:56:24.239946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774479+0000","last_change":"2024-04-16T12:56:23.250986+0000","last_active":"2024-04-16T12:56:24.774479+0000","last_peered":"2024-04-16T12:56:24.774479+0000","last_clean":"2024-04-16T12:56:24.774479+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:24.774479+0000","last_undegraded":"2024-04-16T12:56:24.774479+0000","last_fullsized":"2024-04-16T12:56:24.774479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240865+0000","last_change":"2024-04-16T12:56:23.264583+0000","last_active":"2024-04-16T12:56:24.240865+0000","last_peered":"2024-04-16T12:56:24.240865+0000","last_clean":"2024-04-16T12:56:24.240865+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:24.240865+0000","last_undegraded":"2024-04-16T12:56:24.240865+0000","last_fullsized":"2024-04-16T12:56:24.240865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774820+0000","last_change":"2024-04-16T12:56:23.251151+0000","last_active":"2024-04-16T12:56:24.774820+0000","last_peered":"2024-04-16T12:56:24.774820+0000","last_clean":"2024-04-16T12:56:24.774820+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:24.774820+0000","last_undegraded":"2024-04-16T12:56:24.774820+0000","last_fullsized":"2024-04-16T12:56:24.774820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234908+0000","last_change":"2024-04-16T12:56:23.246317+0000","last_active":"2024-04-16T12:56:24.234908+0000","last_peered":"2024-04-16T12:56:24.234908+0000","last_clean":"2024-04-16T12:56:24.234908+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:24.234908+0000","last_undegraded":"2024-04-16T12:56:24.234908+0000","last_fullsized":"2024-04-16T12:56:24.234908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:01.612495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239773+0000","last_change":"2024-04-16T12:56:23.248073+0000","last_active":"2024-04-16T12:56:24.239773+0000","last_peered":"2024-04-16T12:56:24.239773+0000","last_clean":"2024-04-16T12:56:24.239773+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:24.239773+0000","last_undegraded":"2024-04-16T12:56:24.239773+0000","last_fullsized":"2024-04-16T12:56:24.239773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:23.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272958+0000","last_change":"2024-04-16T12:56:23.258834+0000","last_active":"2024-04-16T12:56:24.272958+0000","last_peered":"2024-04-16T12:56:24.272958+0000","last_clean":"2024-04-16T12:56:24.272958+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:24.272958+0000","last_undegraded":"2024-04-16T12:56:24.272958+0000","last_fullsized":"2024-04-16T12:56:24.272958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239902+0000","last_change":"2024-04-16T12:56:23.247447+0000","last_active":"2024-04-16T12:56:24.239902+0000","last_peered":"2024-04-16T12:56:24.239902+0000","last_clean":"2024-04-16T12:56:24.239902+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:24.239902+0000","last_undegraded":"2024-04-16T12:56:24.239902+0000","last_fullsized":"2024-04-16T12:56:24.239902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775150+0000","last_change":"2024-04-16T12:56:23.254138+0000","last_active":"2024-04-16T12:56:24.775150+0000","last_peered":"2024-04-16T12:56:24.775150+0000","last_clean":"2024-04-16T12:56:24.775150+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:24.775150+0000","last_undegraded":"2024-04-16T12:56:24.775150+0000","last_fullsized":"2024-04-16T12:56:24.775150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239828+0000","last_change":"2024-04-16T12:56:23.250483+0000","last_active":"2024-04-16T12:56:24.239828+0000","last_peered":"2024-04-16T12:56:24.239828+0000","last_clean":"2024-04-16T12:56:24.239828+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:24.239828+0000","last_undegraded":"2024-04-16T12:56:24.239828+0000","last_fullsized":"2024-04-16T12:56:24.239828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:56.608003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239563+0000","last_change":"2024-04-16T12:56:23.249941+0000","last_active":"2024-04-16T12:56:24.239563+0000","last_peered":"2024-04-16T12:56:24.239563+0000","last_clean":"2024-04-16T12:56:24.239563+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:24.239563+0000","last_undegraded":"2024-04-16T12:56:24.239563+0000","last_fullsized":"2024-04-16T12:56:24.239563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:14.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774193+0000","last_change":"2024-04-16T12:56:23.254104+0000","last_active":"2024-04-16T12:56:24.774193+0000","last_peered":"2024-04-16T12:56:24.774193+0000","last_clean":"2024-04-16T12:56:24.774193+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:24.774193+0000","last_undegraded":"2024-04-16T12:56:24.774193+0000","last_fullsized":"2024-04-16T12:56:24.774193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272852+0000","last_change":"2024-04-16T12:56:23.244290+0000","last_active":"2024-04-16T12:56:24.272852+0000","last_peered":"2024-04-16T12:56:24.272852+0000","last_clean":"2024-04-16T12:56:24.272852+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:24.272852+0000","last_undegraded":"2024-04-16T12:56:24.272852+0000","last_fullsized":"2024-04-16T12:56:24.272852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:00.369501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774672+0000","last_change":"2024-04-16T12:56:23.260807+0000","last_active":"2024-04-16T12:56:24.774672+0000","last_peered":"2024-04-16T12:56:24.774672+0000","last_clean":"2024-04-16T12:56:24.774672+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:24.774672+0000","last_undegraded":"2024-04-16T12:56:24.774672+0000","last_fullsized":"2024-04-16T12:56:24.774672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:58.158781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239740+0000","last_change":"2024-04-16T12:56:22.239799+0000","last_active":"2024-04-16T12:56:24.239740+0000","last_peered":"2024-04-16T12:56:24.239740+0000","last_clean":"2024-04-16T12:56:24.239740+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:24.239740+0000","last_undegraded":"2024-04-16T12:56:24.239740+0000","last_fullsized":"2024-04-16T12:56:24.239740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273099+0000","last_change":"2024-04-16T12:56:23.260087+0000","last_active":"2024-04-16T12:56:24.273099+0000","last_peered":"2024-04-16T12:56:24.273099+0000","last_clean":"2024-04-16T12:56:24.273099+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:24.273099+0000","last_undegraded":"2024-04-16T12:56:24.273099+0000","last_fullsized":"2024-04-16T12:56:24.273099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773629+0000","last_change":"2024-04-16T12:56:22.250112+0000","last_active":"2024-04-16T12:56:24.773629+0000","last_peered":"2024-04-16T12:56:24.773629+0000","last_clean":"2024-04-16T12:56:24.773629+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:24.773629+0000","last_undegraded":"2024-04-16T12:56:24.773629+0000","last_fullsized":"2024-04-16T12:56:24.773629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240898+0000","last_change":"2024-04-16T12:56:23.259457+0000","last_active":"2024-04-16T12:56:24.240898+0000","last_peered":"2024-04-16T12:56:24.240898+0000","last_clean":"2024-04-16T12:56:24.240898+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:24.240898+0000","last_undegraded":"2024-04-16T12:56:24.240898+0000","last_fullsized":"2024-04-16T12:56:24.240898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273153+0000","last_change":"2024-04-16T12:56:22.239342+0000","last_active":"2024-04-16T12:56:24.273153+0000","last_peered":"2024-04-16T12:56:24.273153+0000","last_clean":"2024-04-16T12:56:24.273153+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:24.273153+0000","last_undegraded":"2024-04-16T12:56:24.273153+0000","last_fullsized":"2024-04-16T12:56:24.273153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701331+0000","last_change":"2024-04-16T12:56:23.254746+0000","last_active":"2024-04-16T12:56:24.701331+0000","last_peered":"2024-04-16T12:56:24.701331+0000","last_clean":"2024-04-16T12:56:24.701331+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:24.701331+0000","last_undegraded":"2024-04-16T12:56:24.701331+0000","last_fullsized":"2024-04-16T12:56:24.701331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:01.813649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240782+0000","last_change":"2024-04-16T12:56:22.236440+0000","last_active":"2024-04-16T12:56:24.240782+0000","last_peered":"2024-04-16T12:56:24.240782+0000","last_clean":"2024-04-16T12:56:24.240782+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:24.240782+0000","last_undegraded":"2024-04-16T12:56:24.240782+0000","last_fullsized":"2024-04-16T12:56:24.240782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:29.394038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773318+0000","last_change":"2024-04-16T12:56:23.244993+0000","last_active":"2024-04-16T12:56:24.773318+0000","last_peered":"2024-04-16T12:56:24.773318+0000","last_clean":"2024-04-16T12:56:24.773318+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:24.773318+0000","last_undegraded":"2024-04-16T12:56:24.773318+0000","last_fullsized":"2024-04-16T12:56:24.773318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:20:31.715562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774911+0000","last_change":"2024-04-16T12:56:22.249990+0000","last_active":"2024-04-16T12:56:24.774911+0000","last_peered":"2024-04-16T12:56:24.774911+0000","last_clean":"2024-04-16T12:56:24.774911+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:24.774911+0000","last_undegraded":"2024-04-16T12:56:24.774911+0000","last_fullsized":"2024-04-16T12:56:24.774911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774712+0000","last_change":"2024-04-16T12:56:23.250290+0000","last_active":"2024-04-16T12:56:24.774712+0000","last_peered":"2024-04-16T12:56:24.774712+0000","last_clean":"2024-04-16T12:56:24.774712+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:24.774712+0000","last_undegraded":"2024-04-16T12:56:24.774712+0000","last_fullsized":"2024-04-16T12:56:24.774712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774271+0000","last_change":"2024-04-16T12:56:22.244990+0000","last_active":"2024-04-16T12:56:24.774271+0000","last_peered":"2024-04-16T12:56:24.774271+0000","last_clean":"2024-04-16T12:56:24.774271+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:24.774271+0000","last_undegraded":"2024-04-16T12:56:24.774271+0000","last_fullsized":"2024-04-16T12:56:24.774271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240989+0000","last_change":"2024-04-16T12:56:23.262818+0000","last_active":"2024-04-16T12:56:24.240989+0000","last_peered":"2024-04-16T12:56:24.240989+0000","last_clean":"2024-04-16T12:56:24.240989+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:24.240989+0000","last_undegraded":"2024-04-16T12:56:24.240989+0000","last_fullsized":"2024-04-16T12:56:24.240989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272915+0000","last_change":"2024-04-16T12:56:22.244767+0000","last_active":"2024-04-16T12:56:24.272915+0000","last_peered":"2024-04-16T12:56:24.272915+0000","last_clean":"2024-04-16T12:56:24.272915+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:24.272915+0000","last_undegraded":"2024-04-16T12:56:24.272915+0000","last_fullsized":"2024-04-16T12:56:24.272915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701173+0000","last_change":"2024-04-16T12:56:23.250637+0000","last_active":"2024-04-16T12:56:24.701173+0000","last_peered":"2024-04-16T12:56:24.701173+0000","last_clean":"2024-04-16T12:56:24.701173+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:24.701173+0000","last_undegraded":"2024-04-16T12:56:24.701173+0000","last_fullsized":"2024-04-16T12:56:24.701173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:11.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240382+0000","last_change":"2024-04-16T12:56:22.234483+0000","last_active":"2024-04-16T12:56:24.240382+0000","last_peered":"2024-04-16T12:56:24.240382+0000","last_clean":"2024-04-16T12:56:24.240382+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:24.240382+0000","last_undegraded":"2024-04-16T12:56:24.240382+0000","last_fullsized":"2024-04-16T12:56:24.240382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:29.232847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235378+0000","last_change":"2024-04-16T12:56:23.263238+0000","last_active":"2024-04-16T12:56:24.235378+0000","last_peered":"2024-04-16T12:56:24.235378+0000","last_clean":"2024-04-16T12:56:24.235378+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:24.235378+0000","last_undegraded":"2024-04-16T12:56:24.235378+0000","last_fullsized":"2024-04-16T12:56:24.235378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:13.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701409+0000","last_change":"2024-04-16T12:56:22.238150+0000","last_active":"2024-04-16T12:56:24.701409+0000","last_peered":"2024-04-16T12:56:24.701409+0000","last_clean":"2024-04-16T12:56:24.701409+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:24.701409+0000","last_undegraded":"2024-04-16T12:56:24.701409+0000","last_fullsized":"2024-04-16T12:56:24.701409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:25.595114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774533+0000","last_change":"2024-04-16T12:56:23.257979+0000","last_active":"2024-04-16T12:56:24.774533+0000","last_peered":"2024-04-16T12:56:24.774533+0000","last_clean":"2024-04-16T12:56:24.774533+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:24.774533+0000","last_undegraded":"2024-04-16T12:56:24.774533+0000","last_fullsized":"2024-04-16T12:56:24.774533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:15.487311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775262+0000","last_change":"2024-04-16T12:56:22.245209+0000","last_active":"2024-04-16T12:56:24.775262+0000","last_peered":"2024-04-16T12:56:24.775262+0000","last_clean":"2024-04-16T12:56:24.775262+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:24.775262+0000","last_undegraded":"2024-04-16T12:56:24.775262+0000","last_fullsized":"2024-04-16T12:56:24.775262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773565+0000","last_change":"2024-04-16T12:56:23.248914+0000","last_active":"2024-04-16T12:56:24.773565+0000","last_peered":"2024-04-16T12:56:24.773565+0000","last_clean":"2024-04-16T12:56:24.773565+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:24.773565+0000","last_undegraded":"2024-04-16T12:56:24.773565+0000","last_fullsized":"2024-04-16T12:56:24.773565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:20:55.976575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775320+0000","last_change":"2024-04-16T12:56:22.246913+0000","last_active":"2024-04-16T12:56:24.775320+0000","last_peered":"2024-04-16T12:56:24.775320+0000","last_clean":"2024-04-16T12:56:24.775320+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:24.775320+0000","last_undegraded":"2024-04-16T12:56:24.775320+0000","last_fullsized":"2024-04-16T12:56:24.775320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:17:22.875971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240951+0000","last_change":"2024-04-16T12:56:23.260224+0000","last_active":"2024-04-16T12:56:24.240951+0000","last_peered":"2024-04-16T12:56:24.240951+0000","last_clean":"2024-04-16T12:56:24.240951+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:24.240951+0000","last_undegraded":"2024-04-16T12:56:24.240951+0000","last_fullsized":"2024-04-16T12:56:24.240951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701278+0000","last_change":"2024-04-16T12:56:22.238456+0000","last_active":"2024-04-16T12:56:24.701278+0000","last_peered":"2024-04-16T12:56:24.701278+0000","last_clean":"2024-04-16T12:56:24.701278+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:24.701278+0000","last_undegraded":"2024-04-16T12:56:24.701278+0000","last_fullsized":"2024-04-16T12:56:24.701278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773358+0000","last_change":"2024-04-16T12:56:23.243585+0000","last_active":"2024-04-16T12:56:24.773358+0000","last_peered":"2024-04-16T12:56:24.773358+0000","last_clean":"2024-04-16T12:56:24.773358+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:24.773358+0000","last_undegraded":"2024-04-16T12:56:24.773358+0000","last_fullsized":"2024-04-16T12:56:24.773358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:15.609463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701284+0000","last_change":"2024-04-16T12:56:22.249382+0000","last_active":"2024-04-16T12:56:24.701284+0000","last_peered":"2024-04-16T12:56:24.701284+0000","last_clean":"2024-04-16T12:56:24.701284+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:24.701284+0000","last_undegraded":"2024-04-16T12:56:24.701284+0000","last_fullsized":"2024-04-16T12:56:24.701284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:50.831912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700954+0000","last_change":"2024-04-16T12:56:23.244444+0000","last_active":"2024-04-16T12:56:24.700954+0000","last_peered":"2024-04-16T12:56:24.700954+0000","last_clean":"2024-04-16T12:56:24.700954+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:24.700954+0000","last_undegraded":"2024-04-16T12:56:24.700954+0000","last_fullsized":"2024-04-16T12:56:24.700954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272853+0000","last_change":"2024-04-16T12:56:22.245705+0000","last_active":"2024-04-16T12:56:24.272853+0000","last_peered":"2024-04-16T12:56:24.272853+0000","last_clean":"2024-04-16T12:56:24.272853+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:24.272853+0000","last_undegraded":"2024-04-16T12:56:24.272853+0000","last_fullsized":"2024-04-16T12:56:24.272853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:13:05.490129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774443+0000","last_change":"2024-04-16T12:56:23.249636+0000","last_active":"2024-04-16T12:56:24.774443+0000","last_peered":"2024-04-16T12:56:24.774443+0000","last_clean":"2024-04-16T12:56:24.774443+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:24.774443+0000","last_undegraded":"2024-04-16T12:56:24.774443+0000","last_fullsized":"2024-04-16T12:56:24.774443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.723977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239382+0000","last_change":"2024-04-16T12:56:22.236968+0000","last_active":"2024-04-16T12:56:24.239382+0000","last_peered":"2024-04-16T12:56:24.239382+0000","last_clean":"2024-04-16T12:56:24.239382+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:24.239382+0000","last_undegraded":"2024-04-16T12:56:24.239382+0000","last_fullsized":"2024-04-16T12:56:24.239382+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:01:42.842189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701362+0000","last_change":"2024-04-16T12:56:23.249914+0000","last_active":"2024-04-16T12:56:24.701362+0000","last_peered":"2024-04-16T12:56:24.701362+0000","last_clean":"2024-04-16T12:56:24.701362+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:24.701362+0000","last_undegraded":"2024-04-16T12:56:24.701362+0000","last_fullsized":"2024-04-16T12:56:24.701362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774080+0000","last_change":"2024-04-16T12:56:22.241578+0000","last_active":"2024-04-16T12:56:24.774080+0000","last_peered":"2024-04-16T12:56:24.774080+0000","last_clean":"2024-04-16T12:56:24.774080+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:24.774080+0000","last_undegraded":"2024-04-16T12:56:24.774080+0000","last_fullsized":"2024-04-16T12:56:24.774080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:43:03.625407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701194+0000","last_change":"2024-04-16T12:56:23.255179+0000","last_active":"2024-04-16T12:56:24.701194+0000","last_peered":"2024-04-16T12:56:24.701194+0000","last_clean":"2024-04-16T12:56:24.701194+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:24.701194+0000","last_undegraded":"2024-04-16T12:56:24.701194+0000","last_fullsized":"2024-04-16T12:56:24.701194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:56:50.993404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775347+0000","last_change":"2024-04-16T12:56:22.246289+0000","last_active":"2024-04-16T12:56:24.775347+0000","last_peered":"2024-04-16T12:56:24.775347+0000","last_clean":"2024-04-16T12:56:24.775347+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:24.775347+0000","last_undegraded":"2024-04-16T12:56:24.775347+0000","last_fullsized":"2024-04-16T12:56:24.775347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:13:13.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775249+0000","last_change":"2024-04-16T12:56:23.251032+0000","last_active":"2024-04-16T12:56:24.775249+0000","last_peered":"2024-04-16T12:56:24.775249+0000","last_clean":"2024-04-16T12:56:24.775249+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:24.775249+0000","last_undegraded":"2024-04-16T12:56:24.775249+0000","last_fullsized":"2024-04-16T12:56:24.775249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:30.384303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240963+0000","last_change":"2024-04-16T12:56:22.243403+0000","last_active":"2024-04-16T12:56:24.240963+0000","last_peered":"2024-04-16T12:56:24.240963+0000","last_clean":"2024-04-16T12:56:24.240963+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:24.240963+0000","last_undegraded":"2024-04-16T12:56:24.240963+0000","last_fullsized":"2024-04-16T12:56:24.240963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240871+0000","last_change":"2024-04-16T12:56:23.252854+0000","last_active":"2024-04-16T12:56:24.240871+0000","last_peered":"2024-04-16T12:56:24.240871+0000","last_clean":"2024-04-16T12:56:24.240871+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:24.240871+0000","last_undegraded":"2024-04-16T12:56:24.240871+0000","last_fullsized":"2024-04-16T12:56:24.240871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:19.341964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235280+0000","last_change":"2024-04-16T12:56:22.235548+0000","last_active":"2024-04-16T12:56:24.235280+0000","last_peered":"2024-04-16T12:56:24.235280+0000","last_clean":"2024-04-16T12:56:24.235280+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:24.235280+0000","last_undegraded":"2024-04-16T12:56:24.235280+0000","last_fullsized":"2024-04-16T12:56:24.235280+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:23.396756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235305+0000","last_change":"2024-04-16T12:56:23.243697+0000","last_active":"2024-04-16T12:56:24.235305+0000","last_peered":"2024-04-16T12:56:24.235305+0000","last_clean":"2024-04-16T12:56:24.235305+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:24.235305+0000","last_undegraded":"2024-04-16T12:56:24.235305+0000","last_fullsized":"2024-04-16T12:56:24.235305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:20.962466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273026+0000","last_change":"2024-04-16T12:56:22.240190+0000","last_active":"2024-04-16T12:56:24.273026+0000","last_peered":"2024-04-16T12:56:24.273026+0000","last_clean":"2024-04-16T12:56:24.273026+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:24.273026+0000","last_undegraded":"2024-04-16T12:56:24.273026+0000","last_fullsized":"2024-04-16T12:56:24.273026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:00.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774159+0000","last_change":"2024-04-16T12:56:23.250415+0000","last_active":"2024-04-16T12:56:24.774159+0000","last_peered":"2024-04-16T12:56:24.774159+0000","last_clean":"2024-04-16T12:56:24.774159+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:24.774159+0000","last_undegraded":"2024-04-16T12:56:24.774159+0000","last_fullsized":"2024-04-16T12:56:24.774159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235022+0000","last_change":"2024-04-16T12:56:22.249618+0000","last_active":"2024-04-16T12:56:24.235022+0000","last_peered":"2024-04-16T12:56:24.235022+0000","last_clean":"2024-04-16T12:56:24.235022+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:24.235022+0000","last_undegraded":"2024-04-16T12:56:24.235022+0000","last_fullsized":"2024-04-16T12:56:24.235022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:24.089585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773418+0000","last_change":"2024-04-16T12:56:23.246805+0000","last_active":"2024-04-16T12:56:24.773418+0000","last_peered":"2024-04-16T12:56:24.773418+0000","last_clean":"2024-04-16T12:56:24.773418+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:24.773418+0000","last_undegraded":"2024-04-16T12:56:24.773418+0000","last_fullsized":"2024-04-16T12:56:24.773418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:57.921488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.234960+0000","last_change":"2024-04-16T12:56:22.237277+0000","last_active":"2024-04-16T12:56:24.234960+0000","last_peered":"2024-04-16T12:56:24.234960+0000","last_clean":"2024-04-16T12:56:24.234960+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:24.234960+0000","last_undegraded":"2024-04-16T12:56:24.234960+0000","last_fullsized":"2024-04-16T12:56:24.234960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:30:19.269616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774464+0000","last_change":"2024-04-16T12:56:23.256966+0000","last_active":"2024-04-16T12:56:24.774464+0000","last_peered":"2024-04-16T12:56:24.774464+0000","last_clean":"2024-04-16T12:56:24.774464+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:24.774464+0000","last_undegraded":"2024-04-16T12:56:24.774464+0000","last_fullsized":"2024-04-16T12:56:24.774464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774312+0000","last_change":"2024-04-16T12:56:22.242407+0000","last_active":"2024-04-16T12:56:24.774312+0000","last_peered":"2024-04-16T12:56:24.774312+0000","last_clean":"2024-04-16T12:56:24.774312+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:24.774312+0000","last_undegraded":"2024-04-16T12:56:24.774312+0000","last_fullsized":"2024-04-16T12:56:24.774312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701177+0000","last_change":"2024-04-16T12:56:23.250388+0000","last_active":"2024-04-16T12:56:24.701177+0000","last_peered":"2024-04-16T12:56:24.701177+0000","last_clean":"2024-04-16T12:56:24.701177+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:24.701177+0000","last_undegraded":"2024-04-16T12:56:24.701177+0000","last_fullsized":"2024-04-16T12:56:24.701177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:43.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235002+0000","last_change":"2024-04-16T12:56:22.246737+0000","last_active":"2024-04-16T12:56:24.235002+0000","last_peered":"2024-04-16T12:56:24.235002+0000","last_clean":"2024-04-16T12:56:24.235002+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:24.235002+0000","last_undegraded":"2024-04-16T12:56:24.235002+0000","last_fullsized":"2024-04-16T12:56:24.235002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:07:39.565020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.273066+0000","last_change":"2024-04-16T12:56:23.261190+0000","last_active":"2024-04-16T12:56:24.273066+0000","last_peered":"2024-04-16T12:56:24.273066+0000","last_clean":"2024-04-16T12:56:24.273066+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:24.273066+0000","last_undegraded":"2024-04-16T12:56:24.273066+0000","last_fullsized":"2024-04-16T12:56:24.273066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:13.814344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775421+0000","last_change":"2024-04-16T12:56:22.247335+0000","last_active":"2024-04-16T12:56:24.775421+0000","last_peered":"2024-04-16T12:56:24.775421+0000","last_clean":"2024-04-16T12:56:24.775421+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:24.775421+0000","last_undegraded":"2024-04-16T12:56:24.775421+0000","last_fullsized":"2024-04-16T12:56:24.775421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.362454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774680+0000","last_change":"2024-04-16T12:56:23.256848+0000","last_active":"2024-04-16T12:56:24.774680+0000","last_peered":"2024-04-16T12:56:24.774680+0000","last_clean":"2024-04-16T12:56:24.774680+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:24.774680+0000","last_undegraded":"2024-04-16T12:56:24.774680+0000","last_fullsized":"2024-04-16T12:56:24.774680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:58.146915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.235224+0000","last_change":"2024-04-16T12:56:22.243591+0000","last_active":"2024-04-16T12:56:24.235224+0000","last_peered":"2024-04-16T12:56:24.235224+0000","last_clean":"2024-04-16T12:56:24.235224+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:24.235224+0000","last_undegraded":"2024-04-16T12:56:24.235224+0000","last_fullsized":"2024-04-16T12:56:24.235224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:02:18.217322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.701436+0000","last_change":"2024-04-16T12:56:23.252021+0000","last_active":"2024-04-16T12:56:24.701436+0000","last_peered":"2024-04-16T12:56:24.701436+0000","last_clean":"2024-04-16T12:56:24.701436+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:24.701436+0000","last_undegraded":"2024-04-16T12:56:24.701436+0000","last_fullsized":"2024-04-16T12:56:24.701436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:52:46.089249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773610+0000","last_change":"2024-04-16T12:56:22.249658+0000","last_active":"2024-04-16T12:56:24.773610+0000","last_peered":"2024-04-16T12:56:24.773610+0000","last_clean":"2024-04-16T12:56:24.773610+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:24.773610+0000","last_undegraded":"2024-04-16T12:56:24.773610+0000","last_fullsized":"2024-04-16T12:56:24.773610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:56:12.982255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773563+0000","last_change":"2024-04-16T12:56:23.250459+0000","last_active":"2024-04-16T12:56:24.773563+0000","last_peered":"2024-04-16T12:56:24.773563+0000","last_clean":"2024-04-16T12:56:24.773563+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:24.773563+0000","last_undegraded":"2024-04-16T12:56:24.773563+0000","last_fullsized":"2024-04-16T12:56:24.773563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:12.612256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.773733+0000","last_change":"2024-04-16T12:56:22.248150+0000","last_active":"2024-04-16T12:56:24.773733+0000","last_peered":"2024-04-16T12:56:24.773733+0000","last_clean":"2024-04-16T12:56:24.773733+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:24.773733+0000","last_undegraded":"2024-04-16T12:56:24.773733+0000","last_fullsized":"2024-04-16T12:56:24.773733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:32:19.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.272927+0000","last_change":"2024-04-16T12:56:23.254477+0000","last_active":"2024-04-16T12:56:24.272927+0000","last_peered":"2024-04-16T12:56:24.272927+0000","last_clean":"2024-04-16T12:56:24.272927+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:24.272927+0000","last_undegraded":"2024-04-16T12:56:24.272927+0000","last_fullsized":"2024-04-16T12:56:24.272927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:51.838958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.239521+0000","last_change":"2024-04-16T12:56:22.249374+0000","last_active":"2024-04-16T12:56:24.239521+0000","last_peered":"2024-04-16T12:56:24.239521+0000","last_clean":"2024-04-16T12:56:24.239521+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:24.239521+0000","last_undegraded":"2024-04-16T12:56:24.239521+0000","last_fullsized":"2024-04-16T12:56:24.239521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240758+0000","last_change":"2024-04-16T12:56:23.263076+0000","last_active":"2024-04-16T12:56:24.240758+0000","last_peered":"2024-04-16T12:56:24.240758+0000","last_clean":"2024-04-16T12:56:24.240758+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:24.240758+0000","last_undegraded":"2024-04-16T12:56:24.240758+0000","last_fullsized":"2024-04-16T12:56:24.240758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:26.602161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.240392+0000","last_change":"2024-04-16T12:56:22.237945+0000","last_active":"2024-04-16T12:56:24.240392+0000","last_peered":"2024-04-16T12:56:24.240392+0000","last_clean":"2024-04-16T12:56:24.240392+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:24.240392+0000","last_undegraded":"2024-04-16T12:56:24.240392+0000","last_fullsized":"2024-04-16T12:56:24.240392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:17:39.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774745+0000","last_change":"2024-04-16T12:56:23.255117+0000","last_active":"2024-04-16T12:56:24.774745+0000","last_peered":"2024-04-16T12:56:24.774745+0000","last_clean":"2024-04-16T12:56:24.774745+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:24.774745+0000","last_undegraded":"2024-04-16T12:56:24.774745+0000","last_fullsized":"2024-04-16T12:56:24.774745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:29.365725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.700971+0000","last_change":"2024-04-16T12:56:22.238633+0000","last_active":"2024-04-16T12:56:24.700971+0000","last_peered":"2024-04-16T12:56:24.700971+0000","last_clean":"2024-04-16T12:56:24.700971+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:24.700971+0000","last_undegraded":"2024-04-16T12:56:24.700971+0000","last_fullsized":"2024-04-16T12:56:24.700971+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:43:55.600956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.775304+0000","last_change":"2024-04-16T12:56:23.254020+0000","last_active":"2024-04-16T12:56:24.775304+0000","last_peered":"2024-04-16T12:56:24.775304+0000","last_clean":"2024-04-16T12:56:24.775304+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:24.775304+0000","last_undegraded":"2024-04-16T12:56:24.775304+0000","last_fullsized":"2024-04-16T12:56:24.775304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:22.221576+0000","last_clean_scrub_stamp":"2024-04-16T12:56:22.221576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:27.706769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774786+0000","last_change":"2024-04-16T12:56:22.241316+0000","last_active":"2024-04-16T12:56:24.774786+0000","last_peered":"2024-04-16T12:56:24.774786+0000","last_clean":"2024-04-16T12:56:24.774786+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:24.774786+0000","last_undegraded":"2024-04-16T12:56:24.774786+0000","last_fullsized":"2024-04-16T12:56:24.774786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:21.214530+0000","last_clean_scrub_stamp":"2024-04-16T12:56:21.214530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:38.114706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T12:56:24.774155+0000","last_change":"2024-04-16T12:54:56.751778+0000","last_active":"2024-04-16T12:56:24.774155+0000","last_peered":"2024-04-16T12:56:24.774155+0000","last_clean":"2024-04-16T12:56:24.774155+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:24.774155+0000","last_undegraded":"2024-04-16T12:56:24.774155+0000","last_fullsized":"2024-04-16T12:56:24.774155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:54:55.388529+0000","last_clean_scrub_stamp":"2024-04-16T12:54:55.388529+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:45.788740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1044480,"data_stored":781230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":189762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":190826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":438272,"data_stored":189270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1032192,"data_stored":779582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:36.229 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.229 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.229 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.229 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.229 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.230 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.230 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.230 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.231 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.232 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.232 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.232 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.232 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.232 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.233 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.234 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.235 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.236 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.237 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.238 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.239 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.240 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.240 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.240 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.240 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.241 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.241 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.241 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.241 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.241 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.242 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.243 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.244 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.245 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T12:56:22.221576+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.245 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T12:56:21.214530+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.245 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T12:54:55.388529+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=54, tm_sec=55, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=12, tm_min=56, tm_sec=31, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T12:56:36.245 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T12:56:39.088 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-04-16T12:56:39.087+0000 7f6f4b426640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T12:56:41.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2024-04-16T12:56:42.201 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-04-16T12:56:42.200+0000 7f6f4f42e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T12:56:48.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2024-04-16T12:56:54.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2024-04-16T12:56:56.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T12:56:56.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.363+0000 7f4db9c88640 1 Processor -- start 2024-04-16T12:56:56.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.363+0000 7f4db9c88640 1 -- start start 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 0x7f4db415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4db40cd910 0x7f4db40cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 0x7f4db406ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4db406d3a0 con 0x7f4db40cd910 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f4db4144dc0 con 0x7f4db41449e0 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db9c88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4db40b3fb0 con 0x7f4db406ca30 2024-04-16T12:56:56.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4db40cd910 0x7f4db40cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4db40cd910 0x7f4db40cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47594/0 (socket says 172.21.15.18:47594) 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.364+0000 7f4db2ffd640 1 -- 172.21.15.18:0/1204013315 learned_addr learned my addr 172.21.15.18:0/1204013315 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db3fff640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 0x7f4db406ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 -- 172.21.15.18:0/1204013315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 msgr2=0x7f4db406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db37fe640 1 --2- 172.21.15.18:0/1204013315 >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 0x7f4db415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 0x7f4db406ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 -- 172.21.15.18:0/1204013315 >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 msgr2=0x7f4db415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/1204013315 >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 0x7f4db415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 -- 172.21.15.18:0/1204013315 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db40b4290 con 0x7f4db40cd910 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db3fff640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 0x7f4db406ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db37fe640 1 --2- 172.21.15.18:0/1204013315 >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 0x7f4db415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.365+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db40cd910 0x7f4db40cdda0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4db4072c20 tx=0x7f4da802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de10081e64e6488 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db27fc640 1 -- 172.21.15.18:0/1204013315 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8035020 con 0x7f4db40cd910 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db27fc640 1 -- 172.21.15.18:0/1204013315 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da802d040 con 0x7f4db40cd910 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db27fc640 1 -- 172.21.15.18:0/1204013315 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8031a80 con 0x7f4db40cd910 2024-04-16T12:56:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 -- 172.21.15.18:0/1204013315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db40cd910 msgr2=0x7f4db40cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db40cd910 0x7f4db40cdda0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4db4072c20 tx=0x7f4da802b900 comp rx=0 tx=0).stop 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 -- 172.21.15.18:0/1204013315 shutdown_connections 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db406ca30 0x7f4db406ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 --2- 172.21.15.18:0/1204013315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db40cd910 0x7f4db40cdda0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 --2- 172.21.15.18:0/1204013315 >> v2:172.21.15.104:3300/0 conn(0x7f4db41449e0 0x7f4db415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 -- 172.21.15.18:0/1204013315 >> 172.21.15.18:0/1204013315 conn(0x7f4db4071f70 msgr2=0x7f4db4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 -- 172.21.15.18:0/1204013315 shutdown_connections 2024-04-16T12:56:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.366+0000 7f4db9c88640 1 -- 172.21.15.18:0/1204013315 wait complete. 2024-04-16T12:56:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.367+0000 7f4db9c88640 1 Processor -- start 2024-04-16T12:56:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 -- start start 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 0x7f4db40aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 0x7f4db415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40b4b30 con 0x7f4db406ca30 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40b4850 con 0x7f4db41449e0 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.368+0000 7f4db9c88640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f4db4145240 con 0x7f4db40cd910 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47604/0 (socket says 172.21.15.18:47604) 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 -- 172.21.15.18:0/952225303 learned_addr learned my addr 172.21.15.18:0/952225303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 -- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 msgr2=0x7f4db40aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 0x7f4db40aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db3fff640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 0x7f4db415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 0x7f4db40aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 -- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 msgr2=0x7f4db415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 0x7f4db415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 -- 172.21.15.18:0/952225303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db415de20 con 0x7f4db406ca30 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 0x7f4db40aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db3fff640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 0x7f4db415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db37fe640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c7f0 tx=0x7f4da400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4015070 con 0x7f4db406ca30 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da4007a30 con 0x7f4db406ca30 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db406e2d0 con 0x7f4db406ca30 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4007e00 con 0x7f4db406ca30 2024-04-16T12:56:56.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.369+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db415d0e0 con 0x7f4db406ca30 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.370+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db40691e0 con 0x7f4db406ca30 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.371+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4da4018070 con 0x7f4db406ca30 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.371+0000 7f4d9bfff640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 0x7f4da006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.371+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7f4da408bca0 con 0x7f4db406ca30 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.372+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 0x7f4da006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.372+0000 7f4db2ffd640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 0x7f4da006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.376+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4db40691e0 con 0x7f4db406ca30 2024-04-16T12:56:56.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.560+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 --> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4db40752b0 con 0x7f4da006c920 2024-04-16T12:56:56.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.566+0000 7f4d9bfff640 1 -- 172.21.15.18:0/952225303 <== mgr.4102 v2:172.21.15.104:6832/2461371258 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7f4db40752b0 con 0x7f4da006c920 2024-04-16T12:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:56.572 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-16T12:56:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 msgr2=0x7f4da006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 0x7f4da006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da8008030 comp rx=0 tx=0).stop 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 msgr2=0x7f4db406dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c7f0 tx=0x7f4da400cbf0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 shutdown_connections 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f4da006c920 0x7f4da006ede0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4db41449e0 0x7f4db415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f4db40cd910 0x7f4db40aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 --2- 172.21.15.18:0/952225303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4db406ca30 0x7f4db406dcf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 >> 172.21.15.18:0/952225303 conn(0x7f4db4071f70 msgr2=0x7f4db40b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 shutdown_connections 2024-04-16T12:56:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.569+0000 7f4db9c88640 1 -- 172.21.15.18:0/952225303 wait complete. 2024-04-16T12:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-16T12:56:56.544899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237724,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736996,"statfs":{"total":773094113280,"available":772850683904,"internally_reserved":0,"allocated":5021696,"data_stored":2853732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001847"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332661+0000","last_change":"2024-04-16T12:56:43.671871+0000","last_active":"2024-04-16T12:56:50.332661+0000","last_peered":"2024-04-16T12:56:50.332661+0000","last_clean":"2024-04-16T12:56:50.332661+0000","last_became_active":"2024-04-16T12:56:23.251371+0000","last_became_peered":"2024-04-16T12:56:23.251371+0000","last_unstale":"2024-04-16T12:56:50.332661+0000","last_undegraded":"2024-04-16T12:56:50.332661+0000","last_fullsized":"2024-04-16T12:56:50.332661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.671698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.671698+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.671698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:56.858131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332200+0000","last_change":"2024-04-16T12:56:38.671722+0000","last_active":"2024-04-16T12:56:50.332200+0000","last_peered":"2024-04-16T12:56:50.332200+0000","last_clean":"2024-04-16T12:56:50.332200+0000","last_became_active":"2024-04-16T12:56:23.243096+0000","last_became_peered":"2024-04-16T12:56:23.243096+0000","last_unstale":"2024-04-16T12:56:50.332200+0000","last_undegraded":"2024-04-16T12:56:50.332200+0000","last_fullsized":"2024-04-16T12:56:50.332200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.671563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.671563+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.671563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:34.406320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377829+0000","last_change":"2024-04-16T12:56:39.988279+0000","last_active":"2024-04-16T12:56:50.377829+0000","last_peered":"2024-04-16T12:56:50.377829+0000","last_clean":"2024-04-16T12:56:50.377829+0000","last_became_active":"2024-04-16T12:56:23.245460+0000","last_became_peered":"2024-04-16T12:56:23.245460+0000","last_unstale":"2024-04-16T12:56:50.377829+0000","last_undegraded":"2024-04-16T12:56:50.377829+0000","last_fullsized":"2024-04-16T12:56:50.377829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.988174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.988174+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.988174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:55:14.345408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378341+0000","last_change":"2024-04-16T12:56:43.571124+0000","last_active":"2024-04-16T12:56:50.378341+0000","last_peered":"2024-04-16T12:56:50.378341+0000","last_clean":"2024-04-16T12:56:50.378341+0000","last_became_active":"2024-04-16T12:56:23.262952+0000","last_became_peered":"2024-04-16T12:56:23.262952+0000","last_unstale":"2024-04-16T12:56:50.378341+0000","last_undegraded":"2024-04-16T12:56:50.378341+0000","last_fullsized":"2024-04-16T12:56:50.378341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.571010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.571010+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.571010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:59.206409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377640+0000","last_change":"2024-04-16T12:56:40.620594+0000","last_active":"2024-04-16T12:56:50.377640+0000","last_peered":"2024-04-16T12:56:50.377640+0000","last_clean":"2024-04-16T12:56:50.377640+0000","last_became_active":"2024-04-16T12:56:23.252292+0000","last_became_peered":"2024-04-16T12:56:23.252292+0000","last_unstale":"2024-04-16T12:56:50.377640+0000","last_undegraded":"2024-04-16T12:56:50.377640+0000","last_fullsized":"2024-04-16T12:56:50.377640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.620442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.620442+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.620442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:01.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331848+0000","last_change":"2024-04-16T12:56:38.599548+0000","last_active":"2024-04-16T12:56:50.331848+0000","last_peered":"2024-04-16T12:56:50.331848+0000","last_clean":"2024-04-16T12:56:50.331848+0000","last_became_active":"2024-04-16T12:56:23.253137+0000","last_became_peered":"2024-04-16T12:56:23.253137+0000","last_unstale":"2024-04-16T12:56:50.331848+0000","last_undegraded":"2024-04-16T12:56:50.331848+0000","last_fullsized":"2024-04-16T12:56:50.331848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.599428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.599428+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.599428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:46.762155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377905+0000","last_change":"2024-04-16T12:56:41.653553+0000","last_active":"2024-04-16T12:56:50.377905+0000","last_peered":"2024-04-16T12:56:50.377905+0000","last_clean":"2024-04-16T12:56:50.377905+0000","last_became_active":"2024-04-16T12:56:23.243538+0000","last_became_peered":"2024-04-16T12:56:23.243538+0000","last_unstale":"2024-04-16T12:56:50.377905+0000","last_undegraded":"2024-04-16T12:56:50.377905+0000","last_fullsized":"2024-04-16T12:56:50.377905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.653444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.653444+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.653444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:14.042534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332099+0000","last_change":"2024-04-16T12:56:47.628555+0000","last_active":"2024-04-16T12:56:50.332099+0000","last_peered":"2024-04-16T12:56:50.332099+0000","last_clean":"2024-04-16T12:56:50.332099+0000","last_became_active":"2024-04-16T12:56:23.255578+0000","last_became_peered":"2024-04-16T12:56:23.255578+0000","last_unstale":"2024-04-16T12:56:50.332099+0000","last_undegraded":"2024-04-16T12:56:50.332099+0000","last_fullsized":"2024-04-16T12:56:50.332099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:47.628438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:47.628438+0000","last_clean_scrub_stamp":"2024-04-16T12:56:47.628438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:06:07.831790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378037+0000","last_change":"2024-04-16T12:56:38.032825+0000","last_active":"2024-04-16T12:56:50.378037+0000","last_peered":"2024-04-16T12:56:50.378037+0000","last_clean":"2024-04-16T12:56:50.378037+0000","last_became_active":"2024-04-16T12:56:23.244611+0000","last_became_peered":"2024-04-16T12:56:23.244611+0000","last_unstale":"2024-04-16T12:56:50.378037+0000","last_undegraded":"2024-04-16T12:56:50.378037+0000","last_fullsized":"2024-04-16T12:56:50.378037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.032707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.032707+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.032707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:35:45.506467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378261+0000","last_change":"2024-04-16T12:56:47.581235+0000","last_active":"2024-04-16T12:56:50.378261+0000","last_peered":"2024-04-16T12:56:50.378261+0000","last_clean":"2024-04-16T12:56:50.378261+0000","last_became_active":"2024-04-16T12:56:23.253752+0000","last_became_peered":"2024-04-16T12:56:23.253752+0000","last_unstale":"2024-04-16T12:56:50.378261+0000","last_undegraded":"2024-04-16T12:56:50.378261+0000","last_fullsized":"2024-04-16T12:56:50.378261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:47.581117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:47.581117+0000","last_clean_scrub_stamp":"2024-04-16T12:56:47.581117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:23:30.755306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378523+0000","last_change":"2024-04-16T12:56:45.574283+0000","last_active":"2024-04-16T12:56:50.378523+0000","last_peered":"2024-04-16T12:56:50.378523+0000","last_clean":"2024-04-16T12:56:50.378523+0000","last_became_active":"2024-04-16T12:56:23.252979+0000","last_became_peered":"2024-04-16T12:56:23.252979+0000","last_unstale":"2024-04-16T12:56:50.378523+0000","last_undegraded":"2024-04-16T12:56:50.378523+0000","last_fullsized":"2024-04-16T12:56:50.378523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:45.574161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:45.574161+0000","last_clean_scrub_stamp":"2024-04-16T12:56:45.574161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:17:56.066278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378018+0000","last_change":"2024-04-16T12:56:36.106790+0000","last_active":"2024-04-16T12:56:50.378018+0000","last_peered":"2024-04-16T12:56:50.378018+0000","last_clean":"2024-04-16T12:56:50.378018+0000","last_became_active":"2024-04-16T12:56:23.238162+0000","last_became_peered":"2024-04-16T12:56:23.238162+0000","last_unstale":"2024-04-16T12:56:50.378018+0000","last_undegraded":"2024-04-16T12:56:50.378018+0000","last_fullsized":"2024-04-16T12:56:50.378018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.106690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.106690+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.106690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:41.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378049+0000","last_change":"2024-04-16T12:56:49.647584+0000","last_active":"2024-04-16T12:56:50.378049+0000","last_peered":"2024-04-16T12:56:50.378049+0000","last_clean":"2024-04-16T12:56:50.378049+0000","last_became_active":"2024-04-16T12:56:23.256155+0000","last_became_peered":"2024-04-16T12:56:23.256155+0000","last_unstale":"2024-04-16T12:56:50.378049+0000","last_undegraded":"2024-04-16T12:56:50.378049+0000","last_fullsized":"2024-04-16T12:56:50.378049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:49.647472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:49.647472+0000","last_clean_scrub_stamp":"2024-04-16T12:56:49.647472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:35:06.060133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377719+0000","last_change":"2024-04-16T12:56:43.325806+0000","last_active":"2024-04-16T12:56:50.377719+0000","last_peered":"2024-04-16T12:56:50.377719+0000","last_clean":"2024-04-16T12:56:50.377719+0000","last_became_active":"2024-04-16T12:56:23.262497+0000","last_became_peered":"2024-04-16T12:56:23.262497+0000","last_unstale":"2024-04-16T12:56:50.377719+0000","last_undegraded":"2024-04-16T12:56:50.377719+0000","last_fullsized":"2024-04-16T12:56:50.377719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.325655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.325655+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.325655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:55:17.682888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378013+0000","last_change":"2024-04-16T12:56:40.699748+0000","last_active":"2024-04-16T12:56:50.378013+0000","last_peered":"2024-04-16T12:56:50.378013+0000","last_clean":"2024-04-16T12:56:50.378013+0000","last_became_active":"2024-04-16T12:56:23.240864+0000","last_became_peered":"2024-04-16T12:56:23.240864+0000","last_unstale":"2024-04-16T12:56:50.378013+0000","last_undegraded":"2024-04-16T12:56:50.378013+0000","last_fullsized":"2024-04-16T12:56:50.378013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.699637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.699637+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.699637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:54:45.586326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.379305+0000","last_change":"2024-04-16T12:56:50.379305+0000","last_active":"2024-04-16T12:56:50.379305+0000","last_peered":"2024-04-16T12:56:50.379305+0000","last_clean":"2024-04-16T12:56:50.379305+0000","last_became_active":"2024-04-16T12:56:50.379043+0000","last_became_peered":"2024-04-16T12:56:50.379043+0000","last_unstale":"2024-04-16T12:56:50.379305+0000","last_undegraded":"2024-04-16T12:56:50.379305+0000","last_fullsized":"2024-04-16T12:56:50.379305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:47.817007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:47.817007+0000","last_clean_scrub_stamp":"2024-04-16T12:56:47.817007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:14:36.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332842+0000","last_change":"2024-04-16T12:56:49.732080+0000","last_active":"2024-04-16T12:56:50.332842+0000","last_peered":"2024-04-16T12:56:50.332842+0000","last_clean":"2024-04-16T12:56:50.332842+0000","last_became_active":"2024-04-16T12:56:23.260653+0000","last_became_peered":"2024-04-16T12:56:23.260653+0000","last_unstale":"2024-04-16T12:56:50.332842+0000","last_undegraded":"2024-04-16T12:56:50.332842+0000","last_fullsized":"2024-04-16T12:56:50.332842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:49.731973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:49.731973+0000","last_clean_scrub_stamp":"2024-04-16T12:56:49.731973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:06:09.935326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378496+0000","last_change":"2024-04-16T12:56:43.004444+0000","last_active":"2024-04-16T12:56:50.378496+0000","last_peered":"2024-04-16T12:56:50.378496+0000","last_clean":"2024-04-16T12:56:50.378496+0000","last_became_active":"2024-04-16T12:56:23.252235+0000","last_became_peered":"2024-04-16T12:56:23.252235+0000","last_unstale":"2024-04-16T12:56:50.378496+0000","last_undegraded":"2024-04-16T12:56:50.378496+0000","last_fullsized":"2024-04-16T12:56:50.378496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.004338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.004338+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.004338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:48.489531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378327+0000","last_change":"2024-04-16T12:56:41.605629+0000","last_active":"2024-04-16T12:56:50.378327+0000","last_peered":"2024-04-16T12:56:50.378327+0000","last_clean":"2024-04-16T12:56:50.378327+0000","last_became_active":"2024-04-16T12:56:23.252865+0000","last_became_peered":"2024-04-16T12:56:23.252865+0000","last_unstale":"2024-04-16T12:56:50.378327+0000","last_undegraded":"2024-04-16T12:56:50.378327+0000","last_fullsized":"2024-04-16T12:56:50.378327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.605495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.605495+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.605495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:21.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378117+0000","last_change":"2024-04-16T12:56:43.989991+0000","last_active":"2024-04-16T12:56:50.378117+0000","last_peered":"2024-04-16T12:56:50.378117+0000","last_clean":"2024-04-16T12:56:50.378117+0000","last_became_active":"2024-04-16T12:56:23.264407+0000","last_became_peered":"2024-04-16T12:56:23.264407+0000","last_unstale":"2024-04-16T12:56:50.378117+0000","last_undegraded":"2024-04-16T12:56:50.378117+0000","last_fullsized":"2024-04-16T12:56:50.378117+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.989862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.989862+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.989862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:18:34.563465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378173+0000","last_change":"2024-04-16T12:56:43.573982+0000","last_active":"2024-04-16T12:56:50.378173+0000","last_peered":"2024-04-16T12:56:50.378173+0000","last_clean":"2024-04-16T12:56:50.378173+0000","last_became_active":"2024-04-16T12:56:23.250704+0000","last_became_peered":"2024-04-16T12:56:23.250704+0000","last_unstale":"2024-04-16T12:56:50.378173+0000","last_undegraded":"2024-04-16T12:56:50.378173+0000","last_fullsized":"2024-04-16T12:56:50.378173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.573873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.573873+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.573873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:25:59.239924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377833+0000","last_change":"2024-04-16T12:56:44.287894+0000","last_active":"2024-04-16T12:56:50.377833+0000","last_peered":"2024-04-16T12:56:50.377833+0000","last_clean":"2024-04-16T12:56:50.377833+0000","last_became_active":"2024-04-16T12:56:23.262146+0000","last_became_peered":"2024-04-16T12:56:23.262146+0000","last_unstale":"2024-04-16T12:56:50.377833+0000","last_undegraded":"2024-04-16T12:56:50.377833+0000","last_fullsized":"2024-04-16T12:56:50.377833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:44.287794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:44.287794+0000","last_clean_scrub_stamp":"2024-04-16T12:56:44.287794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:15.765396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332344+0000","last_change":"2024-04-16T12:56:42.914165+0000","last_active":"2024-04-16T12:56:50.332344+0000","last_peered":"2024-04-16T12:56:50.332344+0000","last_clean":"2024-04-16T12:56:50.332344+0000","last_became_active":"2024-04-16T12:56:23.250892+0000","last_became_peered":"2024-04-16T12:56:23.250892+0000","last_unstale":"2024-04-16T12:56:50.332344+0000","last_undegraded":"2024-04-16T12:56:50.332344+0000","last_fullsized":"2024-04-16T12:56:50.332344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.914053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.914053+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.914053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:58.170221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377383+0000","last_change":"2024-04-16T12:56:39.661872+0000","last_active":"2024-04-16T12:56:50.377383+0000","last_peered":"2024-04-16T12:56:50.377383+0000","last_clean":"2024-04-16T12:56:50.377383+0000","last_became_active":"2024-04-16T12:56:23.245791+0000","last_became_peered":"2024-04-16T12:56:23.245791+0000","last_unstale":"2024-04-16T12:56:50.377383+0000","last_undegraded":"2024-04-16T12:56:50.377383+0000","last_fullsized":"2024-04-16T12:56:50.377383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.661762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.661762+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.661762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:46.805910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378479+0000","last_change":"2024-04-16T12:56:39.956016+0000","last_active":"2024-04-16T12:56:50.378479+0000","last_peered":"2024-04-16T12:56:50.378479+0000","last_clean":"2024-04-16T12:56:50.378479+0000","last_became_active":"2024-04-16T12:56:23.247797+0000","last_became_peered":"2024-04-16T12:56:23.247797+0000","last_unstale":"2024-04-16T12:56:50.378479+0000","last_undegraded":"2024-04-16T12:56:50.378479+0000","last_fullsized":"2024-04-16T12:56:50.378479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.955934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.955934+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.955934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:29.243320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332104+0000","last_change":"2024-04-16T12:56:40.594899+0000","last_active":"2024-04-16T12:56:50.332104+0000","last_peered":"2024-04-16T12:56:50.332104+0000","last_clean":"2024-04-16T12:56:50.332104+0000","last_became_active":"2024-04-16T12:56:23.258562+0000","last_became_peered":"2024-04-16T12:56:23.258562+0000","last_unstale":"2024-04-16T12:56:50.332104+0000","last_undegraded":"2024-04-16T12:56:50.332104+0000","last_fullsized":"2024-04-16T12:56:50.332104+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.594767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.594767+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.594767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:56.230166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378324+0000","last_change":"2024-04-16T12:56:38.957407+0000","last_active":"2024-04-16T12:56:50.378324+0000","last_peered":"2024-04-16T12:56:50.378324+0000","last_clean":"2024-04-16T12:56:50.378324+0000","last_became_active":"2024-04-16T12:56:23.246949+0000","last_became_peered":"2024-04-16T12:56:23.246949+0000","last_unstale":"2024-04-16T12:56:50.378324+0000","last_undegraded":"2024-04-16T12:56:50.378324+0000","last_fullsized":"2024-04-16T12:56:50.378324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.957303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.957303+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.957303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:14.882642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378438+0000","last_change":"2024-04-16T12:56:48.620037+0000","last_active":"2024-04-16T12:56:50.378438+0000","last_peered":"2024-04-16T12:56:50.378438+0000","last_clean":"2024-04-16T12:56:50.378438+0000","last_became_active":"2024-04-16T12:56:23.253847+0000","last_became_peered":"2024-04-16T12:56:23.253847+0000","last_unstale":"2024-04-16T12:56:50.378438+0000","last_undegraded":"2024-04-16T12:56:50.378438+0000","last_fullsized":"2024-04-16T12:56:50.378438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:48.619908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:48.619908+0000","last_clean_scrub_stamp":"2024-04-16T12:56:48.619908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:14:36.959336+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377959+0000","last_change":"2024-04-16T12:56:41.960530+0000","last_active":"2024-04-16T12:56:50.377959+0000","last_peered":"2024-04-16T12:56:50.377959+0000","last_clean":"2024-04-16T12:56:50.377959+0000","last_became_active":"2024-04-16T12:56:23.249706+0000","last_became_peered":"2024-04-16T12:56:23.249706+0000","last_unstale":"2024-04-16T12:56:50.377959+0000","last_undegraded":"2024-04-16T12:56:50.377959+0000","last_fullsized":"2024-04-16T12:56:50.377959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.960388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.960388+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.960388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:21.552461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377639+0000","last_change":"2024-04-16T12:56:40.921848+0000","last_active":"2024-04-16T12:56:50.377639+0000","last_peered":"2024-04-16T12:56:50.377639+0000","last_clean":"2024-04-16T12:56:50.377639+0000","last_became_active":"2024-04-16T12:56:23.249692+0000","last_became_peered":"2024-04-16T12:56:23.249692+0000","last_unstale":"2024-04-16T12:56:50.377639+0000","last_undegraded":"2024-04-16T12:56:50.377639+0000","last_fullsized":"2024-04-16T12:56:50.377639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.921738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.921738+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.921738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:09.693566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332432+0000","last_change":"2024-04-16T12:56:43.884046+0000","last_active":"2024-04-16T12:56:50.332432+0000","last_peered":"2024-04-16T12:56:50.332432+0000","last_clean":"2024-04-16T12:56:50.332432+0000","last_became_active":"2024-04-16T12:56:23.251631+0000","last_became_peered":"2024-04-16T12:56:23.251631+0000","last_unstale":"2024-04-16T12:56:50.332432+0000","last_undegraded":"2024-04-16T12:56:50.332432+0000","last_fullsized":"2024-04-16T12:56:50.332432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.883902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.883902+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.883902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:52.405805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331700+0000","last_change":"2024-04-16T12:56:37.633144+0000","last_active":"2024-04-16T12:56:50.331700+0000","last_peered":"2024-04-16T12:56:50.331700+0000","last_clean":"2024-04-16T12:56:50.331700+0000","last_became_active":"2024-04-16T12:56:23.244024+0000","last_became_peered":"2024-04-16T12:56:23.244024+0000","last_unstale":"2024-04-16T12:56:50.331700+0000","last_undegraded":"2024-04-16T12:56:50.331700+0000","last_fullsized":"2024-04-16T12:56:50.331700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:37.633025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:37.633025+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.633025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:47:34.938709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332629+0000","last_change":"2024-04-16T12:56:48.775229+0000","last_active":"2024-04-16T12:56:50.332629+0000","last_peered":"2024-04-16T12:56:50.332629+0000","last_clean":"2024-04-16T12:56:50.332629+0000","last_became_active":"2024-04-16T12:56:23.259407+0000","last_became_peered":"2024-04-16T12:56:23.259407+0000","last_unstale":"2024-04-16T12:56:50.332629+0000","last_undegraded":"2024-04-16T12:56:50.332629+0000","last_fullsized":"2024-04-16T12:56:50.332629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:48.775099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:48.775099+0000","last_clean_scrub_stamp":"2024-04-16T12:56:48.775099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:18:21.479129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'5","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378527+0000","last_change":"2024-04-16T12:56:36.971600+0000","last_active":"2024-04-16T12:56:50.378527+0000","last_peered":"2024-04-16T12:56:50.378527+0000","last_clean":"2024-04-16T12:56:50.378527+0000","last_became_active":"2024-04-16T12:56:22.239486+0000","last_became_peered":"2024-04-16T12:56:22.239486+0000","last_unstale":"2024-04-16T12:56:50.378527+0000","last_undegraded":"2024-04-16T12:56:50.378527+0000","last_fullsized":"2024-04-16T12:56:50.378527+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-04-16T12:56:36.971485+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-04-16T12:56:36.971485+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.971485+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:27.362165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332183+0000","last_change":"2024-04-16T12:56:41.626926+0000","last_active":"2024-04-16T12:56:50.332183+0000","last_peered":"2024-04-16T12:56:50.332183+0000","last_clean":"2024-04-16T12:56:50.332183+0000","last_became_active":"2024-04-16T12:56:23.259752+0000","last_became_peered":"2024-04-16T12:56:23.259752+0000","last_unstale":"2024-04-16T12:56:50.332183+0000","last_undegraded":"2024-04-16T12:56:50.332183+0000","last_fullsized":"2024-04-16T12:56:50.332183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.626818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.626818+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.626818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:25:37.836127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'2","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378124+0000","last_change":"2024-04-16T12:56:35.145007+0000","last_active":"2024-04-16T12:56:50.378124+0000","last_peered":"2024-04-16T12:56:50.378124+0000","last_clean":"2024-04-16T12:56:50.378124+0000","last_became_active":"2024-04-16T12:56:22.249816+0000","last_became_peered":"2024-04-16T12:56:22.249816+0000","last_unstale":"2024-04-16T12:56:50.378124+0000","last_undegraded":"2024-04-16T12:56:50.378124+0000","last_fullsized":"2024-04-16T12:56:50.378124+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2024-04-16T12:56:35.144914+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2024-04-16T12:56:35.144914+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.144914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:14.736987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378159+0000","last_change":"2024-04-16T12:56:39.357519+0000","last_active":"2024-04-16T12:56:50.378159+0000","last_peered":"2024-04-16T12:56:50.378159+0000","last_clean":"2024-04-16T12:56:50.378159+0000","last_became_active":"2024-04-16T12:56:23.259176+0000","last_became_peered":"2024-04-16T12:56:23.259176+0000","last_unstale":"2024-04-16T12:56:50.378159+0000","last_undegraded":"2024-04-16T12:56:50.378159+0000","last_fullsized":"2024-04-16T12:56:50.378159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.357406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.357406+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.357406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:44.842599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332276+0000","last_change":"2024-04-16T12:56:33.550184+0000","last_active":"2024-04-16T12:56:50.332276+0000","last_peered":"2024-04-16T12:56:50.332276+0000","last_clean":"2024-04-16T12:56:50.332276+0000","last_became_active":"2024-04-16T12:56:22.239027+0000","last_became_peered":"2024-04-16T12:56:22.239027+0000","last_unstale":"2024-04-16T12:56:50.332276+0000","last_undegraded":"2024-04-16T12:56:50.332276+0000","last_fullsized":"2024-04-16T12:56:50.332276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:33.550067+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:33.550067+0000","last_clean_scrub_stamp":"2024-04-16T12:56:33.550067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:07.305066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332540+0000","last_change":"2024-04-16T12:56:45.651342+0000","last_active":"2024-04-16T12:56:50.332540+0000","last_peered":"2024-04-16T12:56:50.332540+0000","last_clean":"2024-04-16T12:56:50.332540+0000","last_became_active":"2024-04-16T12:56:23.253742+0000","last_became_peered":"2024-04-16T12:56:23.253742+0000","last_unstale":"2024-04-16T12:56:50.332540+0000","last_undegraded":"2024-04-16T12:56:50.332540+0000","last_fullsized":"2024-04-16T12:56:50.332540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:45.651172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:45.651172+0000","last_clean_scrub_stamp":"2024-04-16T12:56:45.651172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:21:54.487549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378132+0000","last_change":"2024-04-16T12:56:35.448955+0000","last_active":"2024-04-16T12:56:50.378132+0000","last_peered":"2024-04-16T12:56:50.378132+0000","last_clean":"2024-04-16T12:56:50.378132+0000","last_became_active":"2024-04-16T12:56:22.235744+0000","last_became_peered":"2024-04-16T12:56:22.235744+0000","last_unstale":"2024-04-16T12:56:50.378132+0000","last_undegraded":"2024-04-16T12:56:50.378132+0000","last_fullsized":"2024-04-16T12:56:50.378132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:35.448830+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:35.448830+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.448830+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:11.374168+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377808+0000","last_change":"2024-04-16T12:56:39.018541+0000","last_active":"2024-04-16T12:56:50.377808+0000","last_peered":"2024-04-16T12:56:50.377808+0000","last_clean":"2024-04-16T12:56:50.377808+0000","last_became_active":"2024-04-16T12:56:23.244718+0000","last_became_peered":"2024-04-16T12:56:23.244718+0000","last_unstale":"2024-04-16T12:56:50.377808+0000","last_undegraded":"2024-04-16T12:56:50.377808+0000","last_fullsized":"2024-04-16T12:56:50.377808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.018391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.018391+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.018391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:56.315251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'2","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378291+0000","last_change":"2024-04-16T12:56:39.691750+0000","last_active":"2024-04-16T12:56:50.378291+0000","last_peered":"2024-04-16T12:56:50.378291+0000","last_clean":"2024-04-16T12:56:50.378291+0000","last_became_active":"2024-04-16T12:56:22.249759+0000","last_became_peered":"2024-04-16T12:56:22.249759+0000","last_unstale":"2024-04-16T12:56:50.378291+0000","last_undegraded":"2024-04-16T12:56:50.378291+0000","last_fullsized":"2024-04-16T12:56:50.378291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-04-16T12:56:39.691635+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-04-16T12:56:39.691635+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.691635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:35.426393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378113+0000","last_change":"2024-04-16T12:56:42.616711+0000","last_active":"2024-04-16T12:56:50.378113+0000","last_peered":"2024-04-16T12:56:50.378113+0000","last_clean":"2024-04-16T12:56:50.378113+0000","last_became_active":"2024-04-16T12:56:23.250016+0000","last_became_peered":"2024-04-16T12:56:23.250016+0000","last_unstale":"2024-04-16T12:56:50.378113+0000","last_undegraded":"2024-04-16T12:56:50.378113+0000","last_fullsized":"2024-04-16T12:56:50.378113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.616593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.616593+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.616593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:06.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'2","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332476+0000","last_change":"2024-04-16T12:56:39.912152+0000","last_active":"2024-04-16T12:56:50.332476+0000","last_peered":"2024-04-16T12:56:50.332476+0000","last_clean":"2024-04-16T12:56:50.332476+0000","last_became_active":"2024-04-16T12:56:22.244599+0000","last_became_peered":"2024-04-16T12:56:22.244599+0000","last_unstale":"2024-04-16T12:56:50.332476+0000","last_undegraded":"2024-04-16T12:56:50.332476+0000","last_fullsized":"2024-04-16T12:56:50.332476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'2","last_scrub_stamp":"2024-04-16T12:56:39.912056+0000","last_deep_scrub":"39'2","last_deep_scrub_stamp":"2024-04-16T12:56:39.912056+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.912056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:10:26.152828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377924+0000","last_change":"2024-04-16T12:56:41.311515+0000","last_active":"2024-04-16T12:56:50.377924+0000","last_peered":"2024-04-16T12:56:50.377924+0000","last_clean":"2024-04-16T12:56:50.377924+0000","last_became_active":"2024-04-16T12:56:23.262206+0000","last_became_peered":"2024-04-16T12:56:23.262206+0000","last_unstale":"2024-04-16T12:56:50.377924+0000","last_undegraded":"2024-04-16T12:56:50.377924+0000","last_fullsized":"2024-04-16T12:56:50.377924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.311407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.311407+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.311407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:35:48.785167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331935+0000","last_change":"2024-04-16T12:56:35.562457+0000","last_active":"2024-04-16T12:56:50.331935+0000","last_peered":"2024-04-16T12:56:50.331935+0000","last_clean":"2024-04-16T12:56:50.331935+0000","last_became_active":"2024-04-16T12:56:22.244426+0000","last_became_peered":"2024-04-16T12:56:22.244426+0000","last_unstale":"2024-04-16T12:56:50.331935+0000","last_undegraded":"2024-04-16T12:56:50.331935+0000","last_fullsized":"2024-04-16T12:56:50.331935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:35.562366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:35.562366+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.562366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:42.706514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332424+0000","last_change":"2024-04-16T12:56:42.675730+0000","last_active":"2024-04-16T12:56:50.332424+0000","last_peered":"2024-04-16T12:56:50.332424+0000","last_clean":"2024-04-16T12:56:50.332424+0000","last_became_active":"2024-04-16T12:56:23.249634+0000","last_became_peered":"2024-04-16T12:56:23.249634+0000","last_unstale":"2024-04-16T12:56:50.332424+0000","last_undegraded":"2024-04-16T12:56:50.332424+0000","last_fullsized":"2024-04-16T12:56:50.332424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.675619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.675619+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.675619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:50.990028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377512+0000","last_change":"2024-04-16T12:56:34.456676+0000","last_active":"2024-04-16T12:56:50.377512+0000","last_peered":"2024-04-16T12:56:50.377512+0000","last_clean":"2024-04-16T12:56:50.377512+0000","last_became_active":"2024-04-16T12:56:22.234212+0000","last_became_peered":"2024-04-16T12:56:22.234212+0000","last_unstale":"2024-04-16T12:56:50.377512+0000","last_undegraded":"2024-04-16T12:56:50.377512+0000","last_fullsized":"2024-04-16T12:56:50.377512+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:34.456550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:34.456550+0000","last_clean_scrub_stamp":"2024-04-16T12:56:34.456550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:28:01.958951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378361+0000","last_change":"2024-04-16T12:56:42.613765+0000","last_active":"2024-04-16T12:56:50.378361+0000","last_peered":"2024-04-16T12:56:50.378361+0000","last_clean":"2024-04-16T12:56:50.378361+0000","last_became_active":"2024-04-16T12:56:23.262905+0000","last_became_peered":"2024-04-16T12:56:23.262905+0000","last_unstale":"2024-04-16T12:56:50.378361+0000","last_undegraded":"2024-04-16T12:56:50.378361+0000","last_fullsized":"2024-04-16T12:56:50.378361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.613643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.613643+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.613643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.481316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332665+0000","last_change":"2024-04-16T12:56:34.743112+0000","last_active":"2024-04-16T12:56:50.332665+0000","last_peered":"2024-04-16T12:56:50.332665+0000","last_clean":"2024-04-16T12:56:50.332665+0000","last_became_active":"2024-04-16T12:56:22.237663+0000","last_became_peered":"2024-04-16T12:56:22.237663+0000","last_unstale":"2024-04-16T12:56:50.332665+0000","last_undegraded":"2024-04-16T12:56:50.332665+0000","last_fullsized":"2024-04-16T12:56:50.332665+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:34.743024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:34.743024+0000","last_clean_scrub_stamp":"2024-04-16T12:56:34.743024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:35:42.216784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332476+0000","last_change":"2024-04-16T12:56:46.863075+0000","last_active":"2024-04-16T12:56:50.332476+0000","last_peered":"2024-04-16T12:56:50.332476+0000","last_clean":"2024-04-16T12:56:50.332476+0000","last_became_active":"2024-04-16T12:56:23.256915+0000","last_became_peered":"2024-04-16T12:56:23.256915+0000","last_unstale":"2024-04-16T12:56:50.332476+0000","last_undegraded":"2024-04-16T12:56:50.332476+0000","last_fullsized":"2024-04-16T12:56:50.332476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:46.862959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:46.862959+0000","last_clean_scrub_stamp":"2024-04-16T12:56:46.862959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:26:31.300818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378532+0000","last_change":"2024-04-16T12:56:35.589138+0000","last_active":"2024-04-16T12:56:50.378532+0000","last_peered":"2024-04-16T12:56:50.378532+0000","last_clean":"2024-04-16T12:56:50.378532+0000","last_became_active":"2024-04-16T12:56:22.244921+0000","last_became_peered":"2024-04-16T12:56:22.244921+0000","last_unstale":"2024-04-16T12:56:50.378532+0000","last_undegraded":"2024-04-16T12:56:50.378532+0000","last_fullsized":"2024-04-16T12:56:50.378532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:35.589020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:35.589020+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.589020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:35:43.062780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377975+0000","last_change":"2024-04-16T12:56:42.031621+0000","last_active":"2024-04-16T12:56:50.377975+0000","last_peered":"2024-04-16T12:56:50.377975+0000","last_clean":"2024-04-16T12:56:50.377975+0000","last_became_active":"2024-04-16T12:56:23.248625+0000","last_became_peered":"2024-04-16T12:56:23.248625+0000","last_unstale":"2024-04-16T12:56:50.377975+0000","last_undegraded":"2024-04-16T12:56:50.377975+0000","last_fullsized":"2024-04-16T12:56:50.377975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.031511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.031511+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.031511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:37.766268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378633+0000","last_change":"2024-04-16T12:56:37.643208+0000","last_active":"2024-04-16T12:56:50.378633+0000","last_peered":"2024-04-16T12:56:50.378633+0000","last_clean":"2024-04-16T12:56:50.378633+0000","last_became_active":"2024-04-16T12:56:22.246550+0000","last_became_peered":"2024-04-16T12:56:22.246550+0000","last_unstale":"2024-04-16T12:56:50.378633+0000","last_undegraded":"2024-04-16T12:56:50.378633+0000","last_fullsized":"2024-04-16T12:56:50.378633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-04-16T12:56:37.643022+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-04-16T12:56:37.643022+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.643022+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:55:12.000256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377780+0000","last_change":"2024-04-16T12:56:40.328188+0000","last_active":"2024-04-16T12:56:50.377780+0000","last_peered":"2024-04-16T12:56:50.377780+0000","last_clean":"2024-04-16T12:56:50.377780+0000","last_became_active":"2024-04-16T12:56:23.259870+0000","last_became_peered":"2024-04-16T12:56:23.259870+0000","last_unstale":"2024-04-16T12:56:50.377780+0000","last_undegraded":"2024-04-16T12:56:50.377780+0000","last_fullsized":"2024-04-16T12:56:50.377780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.328022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.328022+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.328022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:18:30.901625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'7","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332810+0000","last_change":"2024-04-16T12:56:35.708508+0000","last_active":"2024-04-16T12:56:50.332810+0000","last_peered":"2024-04-16T12:56:50.332810+0000","last_clean":"2024-04-16T12:56:50.332810+0000","last_became_active":"2024-04-16T12:56:22.237923+0000","last_became_peered":"2024-04-16T12:56:22.237923+0000","last_unstale":"2024-04-16T12:56:50.332810+0000","last_undegraded":"2024-04-16T12:56:50.332810+0000","last_fullsized":"2024-04-16T12:56:50.332810+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-04-16T12:56:35.708411+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-04-16T12:56:35.708411+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.708411+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:53.005271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377920+0000","last_change":"2024-04-16T12:56:37.067148+0000","last_active":"2024-04-16T12:56:50.377920+0000","last_peered":"2024-04-16T12:56:50.377920+0000","last_clean":"2024-04-16T12:56:50.377920+0000","last_became_active":"2024-04-16T12:56:23.243327+0000","last_became_peered":"2024-04-16T12:56:23.243327+0000","last_unstale":"2024-04-16T12:56:50.377920+0000","last_undegraded":"2024-04-16T12:56:50.377920+0000","last_fullsized":"2024-04-16T12:56:50.377920+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:37.067046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:37.067046+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.067046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:18:27.640650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332684+0000","last_change":"2024-04-16T12:56:37.662149+0000","last_active":"2024-04-16T12:56:50.332684+0000","last_peered":"2024-04-16T12:56:50.332684+0000","last_clean":"2024-04-16T12:56:50.332684+0000","last_became_active":"2024-04-16T12:56:22.249049+0000","last_became_peered":"2024-04-16T12:56:22.249049+0000","last_unstale":"2024-04-16T12:56:50.332684+0000","last_undegraded":"2024-04-16T12:56:50.332684+0000","last_fullsized":"2024-04-16T12:56:50.332684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:37.662035+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:37.662035+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.662035+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:09.139637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332452+0000","last_change":"2024-04-16T12:56:39.677846+0000","last_active":"2024-04-16T12:56:50.332452+0000","last_peered":"2024-04-16T12:56:50.332452+0000","last_clean":"2024-04-16T12:56:50.332452+0000","last_became_active":"2024-04-16T12:56:23.244183+0000","last_became_peered":"2024-04-16T12:56:23.244183+0000","last_unstale":"2024-04-16T12:56:50.332452+0000","last_undegraded":"2024-04-16T12:56:50.332452+0000","last_fullsized":"2024-04-16T12:56:50.332452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.677703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.677703+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.677703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:10:53.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331965+0000","last_change":"2024-04-16T12:56:36.590216+0000","last_active":"2024-04-16T12:56:50.331965+0000","last_peered":"2024-04-16T12:56:50.331965+0000","last_clean":"2024-04-16T12:56:50.331965+0000","last_became_active":"2024-04-16T12:56:22.245440+0000","last_became_peered":"2024-04-16T12:56:22.245440+0000","last_unstale":"2024-04-16T12:56:50.331965+0000","last_undegraded":"2024-04-16T12:56:50.331965+0000","last_fullsized":"2024-04-16T12:56:50.331965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.590129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.590129+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.590129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:14:57.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332400+0000","last_change":"2024-04-16T12:56:40.956794+0000","last_active":"2024-04-16T12:56:50.332400+0000","last_peered":"2024-04-16T12:56:50.332400+0000","last_clean":"2024-04-16T12:56:50.332400+0000","last_became_active":"2024-04-16T12:56:23.249298+0000","last_became_peered":"2024-04-16T12:56:23.249298+0000","last_unstale":"2024-04-16T12:56:50.332400+0000","last_undegraded":"2024-04-16T12:56:50.332400+0000","last_fullsized":"2024-04-16T12:56:50.332400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.956683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.956683+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.956683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:36.691440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377354+0000","last_change":"2024-04-16T12:56:35.943046+0000","last_active":"2024-04-16T12:56:50.377354+0000","last_peered":"2024-04-16T12:56:50.377354+0000","last_clean":"2024-04-16T12:56:50.377354+0000","last_became_active":"2024-04-16T12:56:22.236715+0000","last_became_peered":"2024-04-16T12:56:22.236715+0000","last_unstale":"2024-04-16T12:56:50.377354+0000","last_undegraded":"2024-04-16T12:56:50.377354+0000","last_fullsized":"2024-04-16T12:56:50.377354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:35.942902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:35.942902+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.942902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:47:11.642814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332585+0000","last_change":"2024-04-16T12:56:40.631921+0000","last_active":"2024-04-16T12:56:50.332585+0000","last_peered":"2024-04-16T12:56:50.332585+0000","last_clean":"2024-04-16T12:56:50.332585+0000","last_became_active":"2024-04-16T12:56:23.248990+0000","last_became_peered":"2024-04-16T12:56:23.248990+0000","last_unstale":"2024-04-16T12:56:50.332585+0000","last_undegraded":"2024-04-16T12:56:50.332585+0000","last_fullsized":"2024-04-16T12:56:50.332585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:40.631798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:40.631798+0000","last_clean_scrub_stamp":"2024-04-16T12:56:40.631798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:35:28.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332338+0000","last_change":"2024-04-16T12:56:37.909547+0000","last_active":"2024-04-16T12:56:50.332338+0000","last_peered":"2024-04-16T12:56:50.332338+0000","last_clean":"2024-04-16T12:56:50.332338+0000","last_became_active":"2024-04-16T12:56:22.241315+0000","last_became_peered":"2024-04-16T12:56:22.241315+0000","last_unstale":"2024-04-16T12:56:50.332338+0000","last_undegraded":"2024-04-16T12:56:50.332338+0000","last_fullsized":"2024-04-16T12:56:50.332338+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-04-16T12:56:37.909403+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-04-16T12:56:37.909403+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.909403+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:25:34.118711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332711+0000","last_change":"2024-04-16T12:56:46.603717+0000","last_active":"2024-04-16T12:56:50.332711+0000","last_peered":"2024-04-16T12:56:50.332711+0000","last_clean":"2024-04-16T12:56:50.332711+0000","last_became_active":"2024-04-16T12:56:23.254838+0000","last_became_peered":"2024-04-16T12:56:23.254838+0000","last_unstale":"2024-04-16T12:56:50.332711+0000","last_undegraded":"2024-04-16T12:56:50.332711+0000","last_fullsized":"2024-04-16T12:56:50.332711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:46.603609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:46.603609+0000","last_clean_scrub_stamp":"2024-04-16T12:56:46.603609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:18:19.307638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378385+0000","last_change":"2024-04-16T12:56:36.635131+0000","last_active":"2024-04-16T12:56:50.378385+0000","last_peered":"2024-04-16T12:56:50.378385+0000","last_clean":"2024-04-16T12:56:50.378385+0000","last_became_active":"2024-04-16T12:56:22.245988+0000","last_became_peered":"2024-04-16T12:56:22.245988+0000","last_unstale":"2024-04-16T12:56:50.378385+0000","last_undegraded":"2024-04-16T12:56:50.378385+0000","last_fullsized":"2024-04-16T12:56:50.378385+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2024-04-16T12:56:36.635013+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2024-04-16T12:56:36.635013+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.635013+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:53.931873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378589+0000","last_change":"2024-04-16T12:56:44.612671+0000","last_active":"2024-04-16T12:56:50.378589+0000","last_peered":"2024-04-16T12:56:50.378589+0000","last_clean":"2024-04-16T12:56:50.378589+0000","last_became_active":"2024-04-16T12:56:23.250762+0000","last_became_peered":"2024-04-16T12:56:23.250762+0000","last_unstale":"2024-04-16T12:56:50.378589+0000","last_undegraded":"2024-04-16T12:56:50.378589+0000","last_fullsized":"2024-04-16T12:56:50.378589+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:44.612552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:44.612552+0000","last_clean_scrub_stamp":"2024-04-16T12:56:44.612552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:13.856876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378255+0000","last_change":"2024-04-16T12:56:37.383016+0000","last_active":"2024-04-16T12:56:50.378255+0000","last_peered":"2024-04-16T12:56:50.378255+0000","last_clean":"2024-04-16T12:56:50.378255+0000","last_became_active":"2024-04-16T12:56:22.243134+0000","last_became_peered":"2024-04-16T12:56:22.243134+0000","last_unstale":"2024-04-16T12:56:50.378255+0000","last_undegraded":"2024-04-16T12:56:50.378255+0000","last_fullsized":"2024-04-16T12:56:50.378255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:37.382878+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:37.382878+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.382878+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:06.154706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378065+0000","last_change":"2024-04-16T12:56:38.361903+0000","last_active":"2024-04-16T12:56:50.378065+0000","last_peered":"2024-04-16T12:56:50.378065+0000","last_clean":"2024-04-16T12:56:50.378065+0000","last_became_active":"2024-04-16T12:56:23.252563+0000","last_became_peered":"2024-04-16T12:56:23.252563+0000","last_unstale":"2024-04-16T12:56:50.378065+0000","last_undegraded":"2024-04-16T12:56:50.378065+0000","last_fullsized":"2024-04-16T12:56:50.378065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.361760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.361760+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.361760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:36:17.953833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378407+0000","last_change":"2024-04-16T12:56:33.570558+0000","last_active":"2024-04-16T12:56:50.378407+0000","last_peered":"2024-04-16T12:56:50.378407+0000","last_clean":"2024-04-16T12:56:50.378407+0000","last_became_active":"2024-04-16T12:56:22.235196+0000","last_became_peered":"2024-04-16T12:56:22.235196+0000","last_unstale":"2024-04-16T12:56:50.378407+0000","last_undegraded":"2024-04-16T12:56:50.378407+0000","last_fullsized":"2024-04-16T12:56:50.378407+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2024-04-16T12:56:33.570460+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2024-04-16T12:56:33.570460+0000","last_clean_scrub_stamp":"2024-04-16T12:56:33.570460+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:43:37.951045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378188+0000","last_change":"2024-04-16T12:56:38.615850+0000","last_active":"2024-04-16T12:56:50.378188+0000","last_peered":"2024-04-16T12:56:50.378188+0000","last_clean":"2024-04-16T12:56:50.378188+0000","last_became_active":"2024-04-16T12:56:23.243404+0000","last_became_peered":"2024-04-16T12:56:23.243404+0000","last_unstale":"2024-04-16T12:56:50.378188+0000","last_undegraded":"2024-04-16T12:56:50.378188+0000","last_fullsized":"2024-04-16T12:56:50.378188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.615719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.615719+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.615719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:58:14.552924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331930+0000","last_change":"2024-04-16T12:56:34.552511+0000","last_active":"2024-04-16T12:56:50.331930+0000","last_peered":"2024-04-16T12:56:50.331930+0000","last_clean":"2024-04-16T12:56:50.331930+0000","last_became_active":"2024-04-16T12:56:22.239900+0000","last_became_peered":"2024-04-16T12:56:22.239900+0000","last_unstale":"2024-04-16T12:56:50.331930+0000","last_undegraded":"2024-04-16T12:56:50.331930+0000","last_fullsized":"2024-04-16T12:56:50.331930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:34.552424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:34.552424+0000","last_clean_scrub_stamp":"2024-04-16T12:56:34.552424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:27.818159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.333008+0000","last_change":"2024-04-16T12:56:41.926422+0000","last_active":"2024-04-16T12:56:50.333008+0000","last_peered":"2024-04-16T12:56:50.333008+0000","last_clean":"2024-04-16T12:56:50.333008+0000","last_became_active":"2024-04-16T12:56:23.250161+0000","last_became_peered":"2024-04-16T12:56:23.250161+0000","last_unstale":"2024-04-16T12:56:50.333008+0000","last_undegraded":"2024-04-16T12:56:50.333008+0000","last_fullsized":"2024-04-16T12:56:50.333008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.926301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.926301+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.926301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:10:56.133163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'3","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377686+0000","last_change":"2024-04-16T12:56:37.608644+0000","last_active":"2024-04-16T12:56:50.377686+0000","last_peered":"2024-04-16T12:56:50.377686+0000","last_clean":"2024-04-16T12:56:50.377686+0000","last_became_active":"2024-04-16T12:56:22.249299+0000","last_became_peered":"2024-04-16T12:56:22.249299+0000","last_unstale":"2024-04-16T12:56:50.377686+0000","last_undegraded":"2024-04-16T12:56:50.377686+0000","last_fullsized":"2024-04-16T12:56:50.377686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:37.608522+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:37.608522+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.608522+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:21:11.363521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377802+0000","last_change":"2024-04-16T12:56:41.030983+0000","last_active":"2024-04-16T12:56:50.377802+0000","last_peered":"2024-04-16T12:56:50.377802+0000","last_clean":"2024-04-16T12:56:50.377802+0000","last_became_active":"2024-04-16T12:56:23.246308+0000","last_became_peered":"2024-04-16T12:56:23.246308+0000","last_unstale":"2024-04-16T12:56:50.377802+0000","last_undegraded":"2024-04-16T12:56:50.377802+0000","last_fullsized":"2024-04-16T12:56:50.377802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.030875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.030875+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.030875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:12.508476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377613+0000","last_change":"2024-04-16T12:56:34.616281+0000","last_active":"2024-04-16T12:56:50.377613+0000","last_peered":"2024-04-16T12:56:50.377613+0000","last_clean":"2024-04-16T12:56:50.377613+0000","last_became_active":"2024-04-16T12:56:22.236988+0000","last_became_peered":"2024-04-16T12:56:22.236988+0000","last_unstale":"2024-04-16T12:56:50.377613+0000","last_undegraded":"2024-04-16T12:56:50.377613+0000","last_fullsized":"2024-04-16T12:56:50.377613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:34.616179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:34.616179+0000","last_clean_scrub_stamp":"2024-04-16T12:56:34.616179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:26.208947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.693775+0000","last_change":"2024-04-16T12:56:50.693800+0000","last_active":"2024-04-16T12:56:50.693775+0000","last_peered":"2024-04-16T12:56:50.693775+0000","last_clean":"2024-04-16T12:56:50.693775+0000","last_became_active":"2024-04-16T12:56:23.256686+0000","last_became_peered":"2024-04-16T12:56:23.256686+0000","last_unstale":"2024-04-16T12:56:50.693775+0000","last_undegraded":"2024-04-16T12:56:50.693775+0000","last_fullsized":"2024-04-16T12:56:50.693775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:50.693686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:50.693686+0000","last_clean_scrub_stamp":"2024-04-16T12:56:50.693686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:33:41.463561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332811+0000","last_change":"2024-04-16T12:56:38.953460+0000","last_active":"2024-04-16T12:56:50.332811+0000","last_peered":"2024-04-16T12:56:50.332811+0000","last_clean":"2024-04-16T12:56:50.332811+0000","last_became_active":"2024-04-16T12:56:22.242135+0000","last_became_peered":"2024-04-16T12:56:22.242135+0000","last_unstale":"2024-04-16T12:56:50.332811+0000","last_undegraded":"2024-04-16T12:56:50.332811+0000","last_fullsized":"2024-04-16T12:56:50.332811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:38.953361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:38.953361+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.953361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:20.813547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332552+0000","last_change":"2024-04-16T12:56:41.632387+0000","last_active":"2024-04-16T12:56:50.332552+0000","last_peered":"2024-04-16T12:56:50.332552+0000","last_clean":"2024-04-16T12:56:50.332552+0000","last_became_active":"2024-04-16T12:56:23.249301+0000","last_became_peered":"2024-04-16T12:56:23.249301+0000","last_unstale":"2024-04-16T12:56:50.332552+0000","last_undegraded":"2024-04-16T12:56:50.332552+0000","last_fullsized":"2024-04-16T12:56:50.332552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:41.632278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:41.632278+0000","last_clean_scrub_stamp":"2024-04-16T12:56:41.632278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:50.154181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377432+0000","last_change":"2024-04-16T12:56:36.605494+0000","last_active":"2024-04-16T12:56:50.377432+0000","last_peered":"2024-04-16T12:56:50.377432+0000","last_clean":"2024-04-16T12:56:50.377432+0000","last_became_active":"2024-04-16T12:56:22.246459+0000","last_became_peered":"2024-04-16T12:56:22.246459+0000","last_unstale":"2024-04-16T12:56:50.377432+0000","last_undegraded":"2024-04-16T12:56:50.377432+0000","last_fullsized":"2024-04-16T12:56:50.377432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.605404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.605404+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.605404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:45.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331810+0000","last_change":"2024-04-16T12:56:42.582690+0000","last_active":"2024-04-16T12:56:50.331810+0000","last_peered":"2024-04-16T12:56:50.331810+0000","last_clean":"2024-04-16T12:56:50.331810+0000","last_became_active":"2024-04-16T12:56:23.260811+0000","last_became_peered":"2024-04-16T12:56:23.260811+0000","last_unstale":"2024-04-16T12:56:50.331810+0000","last_undegraded":"2024-04-16T12:56:50.331810+0000","last_fullsized":"2024-04-16T12:56:50.331810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.582559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.582559+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.582559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:24.442745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378476+0000","last_change":"2024-04-16T12:56:38.664806+0000","last_active":"2024-04-16T12:56:50.378476+0000","last_peered":"2024-04-16T12:56:50.378476+0000","last_clean":"2024-04-16T12:56:50.378476+0000","last_became_active":"2024-04-16T12:56:22.246926+0000","last_became_peered":"2024-04-16T12:56:22.246926+0000","last_unstale":"2024-04-16T12:56:50.378476+0000","last_undegraded":"2024-04-16T12:56:50.378476+0000","last_fullsized":"2024-04-16T12:56:50.378476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-04-16T12:56:38.664685+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-04-16T12:56:38.664685+0000","last_clean_scrub_stamp":"2024-04-16T12:56:38.664685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:33:10.142287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332560+0000","last_change":"2024-04-16T12:56:45.892602+0000","last_active":"2024-04-16T12:56:50.332560+0000","last_peered":"2024-04-16T12:56:50.332560+0000","last_clean":"2024-04-16T12:56:50.332560+0000","last_became_active":"2024-04-16T12:56:23.256586+0000","last_became_peered":"2024-04-16T12:56:23.256586+0000","last_unstale":"2024-04-16T12:56:50.332560+0000","last_undegraded":"2024-04-16T12:56:50.332560+0000","last_fullsized":"2024-04-16T12:56:50.332560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:45.892499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:45.892499+0000","last_clean_scrub_stamp":"2024-04-16T12:56:45.892499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:59.078931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377991+0000","last_change":"2024-04-16T12:56:35.635722+0000","last_active":"2024-04-16T12:56:50.377991+0000","last_peered":"2024-04-16T12:56:50.377991+0000","last_clean":"2024-04-16T12:56:50.377991+0000","last_became_active":"2024-04-16T12:56:22.243257+0000","last_became_peered":"2024-04-16T12:56:22.243257+0000","last_unstale":"2024-04-16T12:56:50.377991+0000","last_undegraded":"2024-04-16T12:56:50.377991+0000","last_fullsized":"2024-04-16T12:56:50.377991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:35.635587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:35.635587+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.635587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:15:29.023474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332311+0000","last_change":"2024-04-16T12:56:44.639060+0000","last_active":"2024-04-16T12:56:50.332311+0000","last_peered":"2024-04-16T12:56:50.332311+0000","last_clean":"2024-04-16T12:56:50.332311+0000","last_became_active":"2024-04-16T12:56:23.251713+0000","last_became_peered":"2024-04-16T12:56:23.251713+0000","last_unstale":"2024-04-16T12:56:50.332311+0000","last_undegraded":"2024-04-16T12:56:50.332311+0000","last_fullsized":"2024-04-16T12:56:50.332311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:44.638941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:44.638941+0000","last_clean_scrub_stamp":"2024-04-16T12:56:44.638941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:26:29.076801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377874+0000","last_change":"2024-04-16T12:56:34.190396+0000","last_active":"2024-04-16T12:56:50.377874+0000","last_peered":"2024-04-16T12:56:50.377874+0000","last_clean":"2024-04-16T12:56:50.377874+0000","last_became_active":"2024-04-16T12:56:22.249379+0000","last_became_peered":"2024-04-16T12:56:22.249379+0000","last_unstale":"2024-04-16T12:56:50.377874+0000","last_undegraded":"2024-04-16T12:56:50.377874+0000","last_fullsized":"2024-04-16T12:56:50.377874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:34.190278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:34.190278+0000","last_clean_scrub_stamp":"2024-04-16T12:56:34.190278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:02.962106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378066+0000","last_change":"2024-04-16T12:56:43.045348+0000","last_active":"2024-04-16T12:56:50.378066+0000","last_peered":"2024-04-16T12:56:50.378066+0000","last_clean":"2024-04-16T12:56:50.378066+0000","last_became_active":"2024-04-16T12:56:23.250175+0000","last_became_peered":"2024-04-16T12:56:23.250175+0000","last_unstale":"2024-04-16T12:56:50.378066+0000","last_undegraded":"2024-04-16T12:56:50.378066+0000","last_fullsized":"2024-04-16T12:56:50.378066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:43.045234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:43.045234+0000","last_clean_scrub_stamp":"2024-04-16T12:56:43.045234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:10:57.252096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378279+0000","last_change":"2024-04-16T12:56:33.198154+0000","last_active":"2024-04-16T12:56:50.378279+0000","last_peered":"2024-04-16T12:56:50.378279+0000","last_clean":"2024-04-16T12:56:50.378279+0000","last_became_active":"2024-04-16T12:56:22.247869+0000","last_became_peered":"2024-04-16T12:56:22.247869+0000","last_unstale":"2024-04-16T12:56:50.378279+0000","last_undegraded":"2024-04-16T12:56:50.378279+0000","last_fullsized":"2024-04-16T12:56:50.378279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:33.198061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:33.198061+0000","last_clean_scrub_stamp":"2024-04-16T12:56:33.198061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:51:40.342210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.331726+0000","last_change":"2024-04-16T12:56:39.630125+0000","last_active":"2024-04-16T12:56:50.331726+0000","last_peered":"2024-04-16T12:56:50.331726+0000","last_clean":"2024-04-16T12:56:50.331726+0000","last_became_active":"2024-04-16T12:56:23.254155+0000","last_became_peered":"2024-04-16T12:56:23.254155+0000","last_unstale":"2024-04-16T12:56:50.331726+0000","last_undegraded":"2024-04-16T12:56:50.331726+0000","last_fullsized":"2024-04-16T12:56:50.331726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:39.630016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:39.630016+0000","last_clean_scrub_stamp":"2024-04-16T12:56:39.630016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:03.497689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377738+0000","last_change":"2024-04-16T12:56:37.952029+0000","last_active":"2024-04-16T12:56:50.377738+0000","last_peered":"2024-04-16T12:56:50.377738+0000","last_clean":"2024-04-16T12:56:50.377738+0000","last_became_active":"2024-04-16T12:56:22.249166+0000","last_became_peered":"2024-04-16T12:56:22.249166+0000","last_unstale":"2024-04-16T12:56:50.377738+0000","last_undegraded":"2024-04-16T12:56:50.377738+0000","last_fullsized":"2024-04-16T12:56:50.377738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:37.951889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:37.951889+0000","last_clean_scrub_stamp":"2024-04-16T12:56:37.951889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:28:05.454290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377747+0000","last_change":"2024-04-16T12:56:42.299396+0000","last_active":"2024-04-16T12:56:50.377747+0000","last_peered":"2024-04-16T12:56:50.377747+0000","last_clean":"2024-04-16T12:56:50.377747+0000","last_became_active":"2024-04-16T12:56:23.262464+0000","last_became_peered":"2024-04-16T12:56:23.262464+0000","last_unstale":"2024-04-16T12:56:50.377747+0000","last_undegraded":"2024-04-16T12:56:50.377747+0000","last_fullsized":"2024-04-16T12:56:50.377747+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:42.299258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:42.299258+0000","last_clean_scrub_stamp":"2024-04-16T12:56:42.299258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:59.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.377640+0000","last_change":"2024-04-16T12:56:36.407430+0000","last_active":"2024-04-16T12:56:50.377640+0000","last_peered":"2024-04-16T12:56:50.377640+0000","last_clean":"2024-04-16T12:56:50.377640+0000","last_became_active":"2024-04-16T12:56:22.237471+0000","last_became_peered":"2024-04-16T12:56:22.237471+0000","last_unstale":"2024-04-16T12:56:50.377640+0000","last_undegraded":"2024-04-16T12:56:50.377640+0000","last_fullsized":"2024-04-16T12:56:50.377640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.407311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.407311+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.407311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:46:25.694697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.333016+0000","last_change":"2024-04-16T12:56:44.877003+0000","last_active":"2024-04-16T12:56:50.333016+0000","last_peered":"2024-04-16T12:56:50.333016+0000","last_clean":"2024-04-16T12:56:50.333016+0000","last_became_active":"2024-04-16T12:56:23.254854+0000","last_became_peered":"2024-04-16T12:56:23.254854+0000","last_unstale":"2024-04-16T12:56:50.333016+0000","last_undegraded":"2024-04-16T12:56:50.333016+0000","last_fullsized":"2024-04-16T12:56:50.333016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:44.876891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:44.876891+0000","last_clean_scrub_stamp":"2024-04-16T12:56:44.876891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:23:53.191300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332212+0000","last_change":"2024-04-16T12:56:36.700667+0000","last_active":"2024-04-16T12:56:50.332212+0000","last_peered":"2024-04-16T12:56:50.332212+0000","last_clean":"2024-04-16T12:56:50.332212+0000","last_became_active":"2024-04-16T12:56:22.238328+0000","last_became_peered":"2024-04-16T12:56:22.238328+0000","last_unstale":"2024-04-16T12:56:50.332212+0000","last_undegraded":"2024-04-16T12:56:50.332212+0000","last_fullsized":"2024-04-16T12:56:50.332212+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.700578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.700578+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.700578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:23.614800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.378299+0000","last_change":"2024-04-16T12:56:46.537029+0000","last_active":"2024-04-16T12:56:50.378299+0000","last_peered":"2024-04-16T12:56:50.378299+0000","last_clean":"2024-04-16T12:56:50.378299+0000","last_became_active":"2024-04-16T12:56:23.253726+0000","last_became_peered":"2024-04-16T12:56:23.253726+0000","last_unstale":"2024-04-16T12:56:50.378299+0000","last_undegraded":"2024-04-16T12:56:50.378299+0000","last_fullsized":"2024-04-16T12:56:50.378299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:46.536914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:46.536914+0000","last_clean_scrub_stamp":"2024-04-16T12:56:46.536914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:54:02.514203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332697+0000","last_change":"2024-04-16T12:56:36.916507+0000","last_active":"2024-04-16T12:56:50.332697+0000","last_peered":"2024-04-16T12:56:50.332697+0000","last_clean":"2024-04-16T12:56:50.332697+0000","last_became_active":"2024-04-16T12:56:22.241013+0000","last_became_peered":"2024-04-16T12:56:22.241013+0000","last_unstale":"2024-04-16T12:56:50.332697+0000","last_undegraded":"2024-04-16T12:56:50.332697+0000","last_fullsized":"2024-04-16T12:56:50.332697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T12:56:36.916398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T12:56:36.916398+0000","last_clean_scrub_stamp":"2024-04-16T12:56:36.916398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:52:52.551796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T12:56:50.332996+0000","last_change":"2024-04-16T12:56:35.954461+0000","last_active":"2024-04-16T12:56:50.332996+0000","last_peered":"2024-04-16T12:56:50.332996+0000","last_clean":"2024-04-16T12:56:50.332996+0000","last_became_active":"2024-04-16T12:54:56.748920+0000","last_became_peered":"2024-04-16T12:54:56.748920+0000","last_unstale":"2024-04-16T12:56:50.332996+0000","last_undegraded":"2024-04-16T12:56:50.332996+0000","last_fullsized":"2024-04-16T12:56:50.332996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-04-16T12:56:35.954306+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-04-16T12:56:35.954306+0000","last_clean_scrub_stamp":"2024-04-16T12:56:35.954306+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:18:26.527910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":800572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":209104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":208634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":209126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":487424,"data_stored":210168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":475136,"data_stored":208592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":475136,"data_stored":208612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":798924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T12:56:56.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T12:56:56.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.725+0000 7f84a04c8640 1 Processor -- start 2024-04-16T12:56:56.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.725+0000 7f84a04c8640 1 -- start start 2024-04-16T12:56:56.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f84a04c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f849809b120 0x7f84980d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f84a04c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84980b1b80 con 0x7f849815ecc0 2024-04-16T12:56:56.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f84a04c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84980b1e60 con 0x7f84980ce0d0 2024-04-16T12:56:56.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f84a04c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f849809bfd0 con 0x7f849809b120 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849e264640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f849815ecc0 0x7f849809aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34112/0 (socket says 172.21.15.18:34112) 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849e264640 1 -- 172.21.15.18:0/44302438 learned_addr learned my addr 172.21.15.18:0/44302438 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849da63640 1 --2- 172.21.15.18:0/44302438 >> v2:172.21.15.104:3300/0 conn(0x7f849809b120 0x7f84980d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844413805 0 0) 0x7f84980b1b80 con 0x7f849815ecc0 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8484003520 con 0x7f849815ecc0 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2044165059 0 0) 0x7f8484003520 con 0x7f849815ecc0 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 >> v2:172.21.15.104:3300/0 conn(0x7f849809b120 msgr2=0x7f84980d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 --2- 172.21.15.18:0/44302438 >> v2:172.21.15.104:3300/0 conn(0x7f849809b120 0x7f84980d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 >> v1:172.21.15.104:6789/0 conn(0x7f84980ce0d0 legacy=0x7f84980d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849809bcf0 con 0x7f849815ecc0 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.726+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7f8494001670 con 0x7f849815ecc0 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 >> v1:172.21.15.18:6789/0 conn(0x7f849815ecc0 legacy=0x7f849809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840039b0 0x7f8484003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8484004800 0x7f8484004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 0x7f848400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f849809bfd0 con 0x7f84840051c0 2024-04-16T12:56:56.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f848400c160 con 0x7f84840039b0 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f848400c360 con 0x7f8484004800 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 0x7f848400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849e264640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840039b0 0x7f8484003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849da63640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8484004800 0x7f8484004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 -- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8484004800 msgr2=0x7f8484004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8484004800 0x7f8484004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 -- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840039b0 msgr2=0x7f8484003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840039b0 0x7f8484003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849ea65640 1 -- 172.21.15.18:0/44302438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8484003520 con 0x7f84840051c0 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.727+0000 7f849da63640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f8484004800 0x7f8484004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f849ea65640 1 -- 172.21.15.18:0/44302438 reap_dead start 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f849ea65640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 0x7f848400b9c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8490001e50 tx=0x7f8484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82a1e32c9a39dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490001a70 con 0x7f84840051c0 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8490003bb0 con 0x7f84840051c0 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f849d262640 1 -- 172.21.15.18:0/44302438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900050d0 con 0x7f84840051c0 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f84a04c8640 1 -- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 msgr2=0x7f848400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.728+0000 7f84a04c8640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 0x7f848400b9c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8490001e50 tx=0x7f8484005830 comp rx=0 tx=0).stop 2024-04-16T12:56:56.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.729+0000 7f84a04c8640 1 -- 172.21.15.18:0/44302438 shutdown_connections 2024-04-16T12:56:56.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.729+0000 7f84a04c8640 1 --2- 172.21.15.18:0/44302438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84840051c0 0x7f848400b9c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.729+0000 7f84a04c8640 1 -- 172.21.15.18:0/44302438 >> 172.21.15.18:0/44302438 conn(0x7f84980d26d0 msgr2=0x7f84980d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.729+0000 7f84a04c8640 1 -- 172.21.15.18:0/44302438 shutdown_connections 2024-04-16T12:56:56.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.729+0000 7f84a04c8640 1 -- 172.21.15.18:0/44302438 wait complete. 2024-04-16T12:56:56.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.730+0000 7f84a04c8640 1 Processor -- start 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.730+0000 7f84a04c8640 1 -- start start 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.730+0000 7f84a04c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840051c0 0x7f84981f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f849815ae00 0x7f84980c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f849815f220 con 0x7f84981f4cd0 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f849815f0a0 con 0x7f84840051c0 2024-04-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7f8498070260 con 0x7f849815ae00 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47632/0 (socket says 172.21.15.18:47632) 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 -- 172.21.15.18:0/249422282 learned_addr learned my addr 172.21.15.18:0/249422282 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849e264640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840051c0 0x7f84981f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849da63640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f849815ae00 0x7f84980c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 -- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f849815ae00 msgr2=0x7f84980c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f849815ae00 0x7f84980c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 -- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840051c0 msgr2=0x7f84981f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840051c0 0x7f84981f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 -- 172.21.15.18:0/249422282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84981f5290 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f849ea65640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8490001f70 tx=0x7f84900014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490006d60 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8490039480 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490039870 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84981f5570 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.731+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849815bb00 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.732+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849806eb00 con 0x7f84981f4cd0 2024-04-16T12:56:56.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.733+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8490039a10 con 0x7f84981f4cd0 2024-04-16T12:56:56.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.733+0000 7f848effd640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 0x7f847c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:56.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.733+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7f84900ada80 con 0x7f84981f4cd0 2024-04-16T12:56:56.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.734+0000 7f849e264640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 0x7f847c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:56.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.734+0000 7f849e264640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 0x7f847c06ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84980b84e0 tx=0x7f8494009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:56.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.738+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f849806eb00 con 0x7f84981f4cd0 2024-04-16T12:56:56.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.920+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f84980b2ae0 con 0x7f84981f4cd0 2024-04-16T12:56:56.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.923+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f84980b2ae0 con 0x7f84981f4cd0 2024-04-16T12:56:56.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.924+0000 7f848effd640 1 -- 172.21.15.18:0/249422282 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8490003bb0 con 0x7f84981f4cd0 2024-04-16T12:56:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.925+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 msgr2=0x7f847c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.925+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 0x7f847c06ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84980b84e0 tx=0x7f8494009040 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.925+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 msgr2=0x7f84980c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.925+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8490001f70 tx=0x7f84900014a0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 shutdown_connections 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7f847c06c920 0x7f847c06ede0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84981f4cd0 0x7f84980c8c10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7f849815ae00 0x7f84980c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 --2- 172.21.15.18:0/249422282 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84840051c0 0x7f84981f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 >> 172.21.15.18:0/249422282 conn(0x7f84980d26d0 msgr2=0x7f84980b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 shutdown_connections 2024-04-16T12:56:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:56.926+0000 7f84a04c8640 1 -- 172.21.15.18:0/249422282 wait complete. 2024-04-16T12:56:56.938 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T12:56:56.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T12:56:57.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.041+0000 7ff9140c8640 1 Processor -- start 2024-04-16T12:56:57.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.041+0000 7ff9140c8640 1 -- start start 2024-04-16T12:56:57.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff9140c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff90c06c130 0x7ff90c0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff9140c8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c06c6c0 con 0x7ff90c06d520 2024-04-16T12:56:57.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff9140c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c0d2db0 con 0x7ff90c162240 2024-04-16T12:56:57.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff9140c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff90c06c9a0 con 0x7ff90c06c130 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff911663640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff90c06d520 0x7ff90c06ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34120/0 (socket says 172.21.15.18:34120) 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff911663640 1 -- 172.21.15.18:0/4221133332 learned_addr learned my addr 172.21.15.18:0/4221133332 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff912665640 1 --2- 172.21.15.18:0/4221133332 >> v2:172.21.15.104:3300/0 conn(0x7ff90c06c130 0x7ff90c0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92282087 0 0) 0x7ff90c06c6c0 con 0x7ff90c06d520 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f8003520 con 0x7ff90c06d520 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 414049311 0 0) 0x7ff8f8003520 con 0x7ff90c06d520 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 >> v2:172.21.15.104:3300/0 conn(0x7ff90c06c130 msgr2=0x7ff90c0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:57.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 --2- 172.21.15.18:0/4221133332 >> v2:172.21.15.104:3300/0 conn(0x7ff90c06c130 0x7ff90c0b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 >> v1:172.21.15.104:6789/0 conn(0x7ff90c162240 legacy=0x7ff90c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0d3090 con 0x7ff90c06d520 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2603988287 0 0) 0x7ff8fc001670 con 0x7ff90c06d520 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 >> v1:172.21.15.18:6789/0 conn(0x7ff90c06d520 legacy=0x7ff90c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff8f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8f8004800 0x7ff8f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8f80051c0 0x7ff8f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c06c9a0 con 0x7ff8f80039b0 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f800c160 con 0x7ff8f8004800 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.042+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f800c360 con 0x7ff8f80051c0 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff8f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911663640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8f8004800 0x7ff8f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff912665640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8f80051c0 0x7ff8f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 -- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8f80051c0 msgr2=0x7ff8f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff8f80051c0 0x7ff8f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 -- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8f8004800 msgr2=0x7ff8f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T12:56:57.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8f8004800 0x7ff8f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff912665640 1 -- 172.21.15.18:0/4221133332 reap_dead start 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.043+0000 7ff911e64640 1 -- 172.21.15.18:0/4221133332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f8003520 con 0x7ff8f80039b0 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff911e64640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff8f8003dd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff908001750 tx=0x7ff8f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbd67277a89c985 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908001370 con 0x7ff8f80039b0 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff9080052d0 con 0x7ff8f80039b0 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff910e62640 1 -- 172.21.15.18:0/4221133332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908003850 con 0x7ff8f80039b0 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 -- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 msgr2=0x7ff8f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff8f8003dd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff908001750 tx=0x7ff8f8005830 comp rx=0 tx=0).stop 2024-04-16T12:56:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 -- 172.21.15.18:0/4221133332 shutdown_connections 2024-04-16T12:56:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 --2- 172.21.15.18:0/4221133332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff8f8003dd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 -- 172.21.15.18:0/4221133332 >> 172.21.15.18:0/4221133332 conn(0x7ff90c0d48b0 msgr2=0x7ff90c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 -- 172.21.15.18:0/4221133332 shutdown_connections 2024-04-16T12:56:57.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.044+0000 7ff9140c8640 1 -- 172.21.15.18:0/4221133332 wait complete. 2024-04-16T12:56:57.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 Processor -- start 2024-04-16T12:56:57.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 -- start start 2024-04-16T12:56:57.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 --2- >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff90c0b4b20 0x7ff90c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff90c0c8840 0x7ff90c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c0b7e90 con 0x7ff8f80039b0 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c0b7d10 con 0x7ff90c0c8840 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff9140c8640 1 -- --> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c06ba20 con 0x7ff90c0b4b20 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff911e64640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff911e64640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47640/0 (socket says 172.21.15.18:47640) 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.046+0000 7ff911e64640 1 -- 172.21.15.18:0/3813774246 learned_addr learned my addr 172.21.15.18:0/3813774246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-16T12:56:57.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911663640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff90c0b4b20 0x7ff90c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff912665640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff90c0c8840 0x7ff90c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 -- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff90c0b4b20 msgr2=0x7ff90c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff90c0b4b20 0x7ff90c0b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 -- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff90c0c8840 msgr2=0x7ff90c0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff90c0c8840 0x7ff90c0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 -- 172.21.15.18:0/3813774246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0cc7d0 con 0x7ff8f80039b0 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff911e64640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c00 tx=0x7ff908001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908041020 con 0x7ff8f80039b0 2024-04-16T12:56:57.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff908005480 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c0ccab0 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908001370 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.047+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c0c9200 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.048+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90c0d4ec0 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.049+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff908044020 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.049+0000 7ff9027fc640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 0x7ff8f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.049+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7ff9080ad760 con 0x7ff8f80039b0 2024-04-16T12:56:57.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.049+0000 7ff911663640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 0x7ff8f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T12:56:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.050+0000 7ff911663640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 0x7ff8f006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0cb490 tx=0x7ff8fc000f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T12:56:57.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.053+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff90c0d4ec0 con 0x7ff8f80039b0 2024-04-16T12:56:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.280+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff90c0b54c0 con 0x7ff8f80039b0 2024-04-16T12:56:57.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.281+0000 7ff9027fc640 1 -- 172.21.15.18:0/3813774246 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+4360 (secure 0 0 0) 0x7ff90c0b54c0 con 0x7ff8f80039b0 2024-04-16T12:56:57.283 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-16T12:56:57.283 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2705826407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2705826407},{"type":"v1","addr":"172.21.15.104:6837","nonce":2705826407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2742340700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2742340700},{"type":"v1","addr":"172.21.15.18:6834","nonce":2742340700}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T12:56:22.604428+0000","modified":"2024-04-16T12:56:42.084188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5337":{"gid":5337,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6835/2957312314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2957312314},{"type":"v1","addr":"172.21.15.18:6835","nonce":2957312314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5337,"qdb_cluster":[5337]},"id":2}]} 2024-04-16T12:56:57.283 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-04-16T12:56:57.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 msgr2=0x7ff8f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 0x7ff8f006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0cb490 tx=0x7ff8fc000f80 comp rx=0 tx=0).stop 2024-04-16T12:56:57.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 msgr2=0x7ff90c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c00 tx=0x7ff908001120 comp rx=0 tx=0).stop 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 shutdown_connections 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:6832/2461371258,v1:172.21.15.104:6833/2461371258] conn(0x7ff8f006c8f0 0x7ff8f006edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff90c0c8840 0x7ff90c0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x7ff90c0b4b20 0x7ff90c0b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 --2- 172.21.15.18:0/3813774246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8f80039b0 0x7ff90c153760 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 >> 172.21.15.18:0/3813774246 conn(0x7ff90c0d48b0 msgr2=0x7ff90c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 shutdown_connections 2024-04-16T12:56:57.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-16T12:56:57.283+0000 7ff9140c8640 1 -- 172.21.15.18:0/3813774246 wait complete. 2024-04-16T12:56:57.295 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T12:56:57.295 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T12:56:57.295 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T12:56:57.296 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.305 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T12:56:57.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T12:56:57.305 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.354 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T12:56:57.355 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T12:56:57.355 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:56:57.355 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-04-16T12:56:57.364 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T12:56:57.364 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T12:56:57.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.376 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T12:56:57.376 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T12:56:57.377 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T12:56:57.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.442 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T12:56:57.442 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T12:56:57.442 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.472 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T12:56:57.473 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T12:56:57.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.539 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T12:56:57.540 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T12:56:57.540 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.610 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T12:56:57.611 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T12:56:57.611 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.646 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T12:56:57.646 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T12:56:57.646 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.714 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T12:56:57.714 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T12:56:57.714 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.783 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T12:56:57.783 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T12:56:57.783 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.853 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T12:56:57.853 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T12:56:57.854 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T12:56:57.854 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.878 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T12:56:57.879 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T12:56:57.879 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.923 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T12:56:57.923 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T12:56:57.923 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T12:56:57.923 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.934 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T12:56:57.934 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T12:56:57.934 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:57.975 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T12:56:57.975 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T12:56:57.975 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T12:56:58.026 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T12:56:58.026 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T12:56:58.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-16T12:56:58.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:58.059 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T12:56:58.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:58.257 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T12:56:58.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:58.329 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T12:56:58.512 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:56:58.513 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T12:56:58.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:58.571 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T12:56:58.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:58.797 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T12:56:58.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:58.869 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T12:56:58.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:56:58.927 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T12:56:58.984 INFO:tasks.ceph:Archiving mon data... 2024-04-16T12:56:58.985 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/data/mon.a.tgz 2024-04-16T12:56:58.986 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-16T12:56:59.001 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.3JmClci7P6 2024-04-16T12:56:59.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3JmClci7P6 2024-04-16T12:56:59.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.3JmClci7P6 2024-04-16T12:56:59.221 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.3JmClci7P6 is 309KB 2024-04-16T12:56:59.318 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.3JmClci7P6 2024-04-16T12:56:59.334 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/data/mon.b.tgz 2024-04-16T12:56:59.335 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-16T12:56:59.351 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.HP2sY91jcb 2024-04-16T12:56:59.352 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HP2sY91jcb 2024-04-16T12:56:59.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.HP2sY91jcb 2024-04-16T12:56:59.590 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.HP2sY91jcb is 411KB 2024-04-16T12:56:59.660 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.HP2sY91jcb 2024-04-16T12:56:59.675 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/data/mon.c.tgz 2024-04-16T12:56:59.676 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-16T12:56:59.731 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.Ui0Fqn92Kw 2024-04-16T12:56:59.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ui0Fqn92Kw 2024-04-16T12:56:59.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-16T12:56:59.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.Ui0Fqn92Kw 2024-04-16T12:56:59.958 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.Ui0Fqn92Kw is 414KB 2024-04-16T12:57:00.057 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.Ui0Fqn92Kw 2024-04-16T12:57:00.072 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T12:57:00.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T12:57:00.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T12:57:00.159 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T12:57:00.196 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T12:57:00.196 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T12:57:00.198 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi018/crash 2024-04-16T12:57:00.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T12:57:00.229 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi104/crash 2024-04-16T12:57:00.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T12:57:00.270 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T12:57:00.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:00.275 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:00.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:00.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T12:57:00.411 INFO:tasks.ceph:Compressing logs... 2024-04-16T12:57:00.411 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T12:57:00.424 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T12:57:00.505 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T12:57:00.505 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44152.log 2024-04-16T12:57:00.505 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37632.log 2024-04-16T12:57:00.505 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.3.44152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2024-04-16T12:57:00.505 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44152.log.gz 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43751.log 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37752.log 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37632.log.gz 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.1.43751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43751.log.gz 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43756.log 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37752.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.1.43756.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37752.log.gz 2024-04-16T12:57:00.506 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43756.log.gz 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44156.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.3.44156.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.3.44156.log.gz 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37712.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T12:57:00.507 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37792.log 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37792.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37792.log.gz 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T12:57:00.508 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37512.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37672.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T12:57:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.d.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-16T12:57:00.526 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T12:57:00.533 INFO:teuthology.orchestra.run.smithi104.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T12:57:00.557 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-04-16T12:57:00.557 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2024-04-16T12:57:00.558 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2024-04-16T12:57:00.558 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46095.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-04-16T12:57:00.558 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51107.log 2024-04-16T12:57:00.558 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz/var/log/ceph/ceph-client.admin.46263.log: 2024-04-16T12:57:00.558 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6%/var/log/ceph/ceph-client.admin.51107.log: -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50610.log 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51107.log.gz 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51414.log 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50610.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2%/var/log/ceph/ceph-client.admin.51414.log: -- replaced with /var/log/ceph/ceph-client.admin.50610.log.gz 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T12:57:00.559 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51414.log.gz 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45881.log 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48513.log 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50736.log 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49584.log 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48513.log.gz 2024-04-16T12:57:00.560 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49584.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50736.log.gz 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49059.log 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6%/var/log/ceph/ceph-client.admin.43582.log: -- replaced with /var/log/ceph/ceph-client.admin.49584.log.gz 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49296.log 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49059.log.gz 2024-04-16T12:57:00.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49296.log.gz 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45153.log 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45153.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gzgzip 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51838.log 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45153.log.gz 2024-04-16T12:57:00.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.51838.log: -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43774.log 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52406.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51838.log.gz 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43774.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43774.log.gz 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2024-04-16T12:57:00.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51150.log 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%/var/log/ceph/ceph-client.admin.44387.log: -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46179.log 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45869.log 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46179.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51150.log.gz 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50526.log 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46179.log.gz 2024-04-16T12:57:00.564 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50694.log 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45869.log.gz 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48723.log 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50694.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50526.log.gz 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52448.log 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50694.log.gz 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48723.log.gz 2024-04-16T12:57:00.565 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51584.log 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48471.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52448.log.gz 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51584.log.gz 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2024-04-16T12:57:00.566 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51026.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48177.log 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49017.log 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48177.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50862.log 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49017.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48177.log.gz 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37583.log 2024-04-16T12:57:00.567 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49017.log.gz 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37583.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50862.log.gz 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47297.log 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.37583.log.gz 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50064.log 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2024-04-16T12:57:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.47297.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.48597.log 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.0.47297.log.gz 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46137.log 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46767.log 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50064.log.gz 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48597.log.gz 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46767.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46137.log.gz 2024-04-16T12:57:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45111.log 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46767.log.gz 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45111.log.gz 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.42671.log: -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48933.log 2024-04-16T12:57:00.570 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48933.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45363.log 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48933.log.gz 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47738.log 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.2.47738.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45363.log.gz 2024-04-16T12:57:00.571 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47738.log.gz 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52574.log 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2024-04-16T12:57:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52574.log.gz 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51456.log 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50568.log 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51456.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48051.log 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51456.log.gz 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2024-04-16T12:57:00.573 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50568.log.gz 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51796.log 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48051.log.gz 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49458.log 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45237.log 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51796.log.gz 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45237.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-04-16T12:57:00.574 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45535.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45237.log.gz 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51200.log 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43414.log 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47734.log 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51200.log.gz 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48261.log 2024-04-16T12:57:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50778.log 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43414.log.gz 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.2.47734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47734.log.gz 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48261.log.gz 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50778.log.gz 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51245.log 2024-04-16T12:57:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44865.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52364.log 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51245.log.gz 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52364.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52364.log.gz 2024-04-16T12:57:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50484.log 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46599.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52658.log 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53235.log 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50484.log.gz 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53235.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52658.log.gz 2024-04-16T12:57:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43114.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53235.log.gz 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37809.log 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48135.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-04-16T12:57:00.579 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51372.log 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46557.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37809.log.gz 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51712.log 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51372.log.gz 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51922.log 2024-04-16T12:57:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52048.log 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51922.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51712.log.gz 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51754.log 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51922.log.gz 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45871.log 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51754.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52048.log.gz 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51754.log.gz 2024-04-16T12:57:00.581 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45871.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45871.log.gz 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-04-16T12:57:00.582 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43624.log: /var/log/ceph/ceph-client.admin.44513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50442.log 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44471.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz -5 2024-04-16T12:57:00.583 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50442.log: /var/log/ceph/ceph-client.admin.43456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50442.log.gz 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47967.log 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45538.log: /var/log/ceph/ceph-client.admin.43242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51498.log 2024-04-16T12:57:00.584 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47967.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51288.log 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51498.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47967.log.gz 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44195.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.51498.log.gz /var/log/ceph/ceph-client.admin.49170.log 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53012.log 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51288.log: /var/log/ceph/ceph-client.admin.49170.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51288.log.gz 2024-04-16T12:57:00.585 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45279.log 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48765.log 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45279.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53012.log.gz 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45279.log.gz 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45880.log 2024-04-16T12:57:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48765.log.gz 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46221.log 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45880.log.gz 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45878.log 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52928.log 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46221.log: /var/log/ceph/ceph-client.admin.45878.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46221.log.gz 2024-04-16T12:57:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52490.log 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45878.log.gz 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52928.log: /var/log/ceph/ceph-client.admin.52490.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52928.log.gz 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.50820.log 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52490.log.gz 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46725.log: /var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-04-16T12:57:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50820.log: /var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50820.log.gz 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45069.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52700.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31528.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2024-04-16T12:57:00.589 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.31528.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31528.log.gz 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.43286.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45321.log 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2024-04-16T12:57:00.590 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45321.log.gz 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44697.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42846.log 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6%/var/log/ceph/ceph-client.admin.52322.log: -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-04-16T12:57:00.591 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45545.log 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45545.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42846.log.gz 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48807.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45545.log.gz 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50904.log 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49338.log 2024-04-16T12:57:00.592 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37912.log 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50904.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53096.log 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50904.log.gz 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49338.log.gz 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37912.log.gz 2024-04-16T12:57:00.593 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53096.log: /var/log/ceph/ceph-client.admin.48387.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53096.log.gz 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.53054.log 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46305.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45864.log 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53054.log.gz 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-04-16T12:57:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45864.log: /var/log/ceph/ceph-client.admin.50148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45879.log 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45864.log.gz 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43540.log: /var/log/ceph/ceph-client.admin.45879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48681.log 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0%/var/log/ceph/ceph-client.admin.45544.log: -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45879.log.gz 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2024-04-16T12:57:00.595 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43708.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42927.log 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48681.log.gz 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42927.log: /var/log/ceph/ceph-client.admin.49542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2024-04-16T12:57:00.596 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7%/var/log/ceph/ceph-client.admin.51964.log: -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gz 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46683.log 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43498.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44943.log 2024-04-16T12:57:00.597 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46683.log.gz 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49380.log 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48891.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44943.log.gz 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52238.log 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49380.log.gz 2024-04-16T12:57:00.598 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48555.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52238.log.gz 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42969.log 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48345.log 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48345.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42969.log.gz 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T12:57:00.599 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48345.log.gz 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47292.log 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51628.log 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5%/var/log/ceph/ceph-client.0.47292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43030.log 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47292.log.gz 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51628.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T12:57:00.600 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51628.log.gz 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43030.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44555.log 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46389.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43030.log.gz 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44555.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.50652.log 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T12:57:00.601 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44555.log.gz 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50652.log.gz 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50190.log 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47871.log: /var/log/ceph/ceph-client.admin.50190.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50190.log.gz 2024-04-16T12:57:00.602 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48429.log 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48219.log 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48429.log.gz 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49668.log: /var/log/ceph/ceph-client.admin.48219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48639.log 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48219.log.gz 2024-04-16T12:57:00.603 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz/var/log/ceph/ceph-client.admin.43198.log: 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52742.log 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 88.4% 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48639.log.gz 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.44429.log: -- replaced with /var/log/ceph/ceph-client.admin.52742.log.gz 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2024-04-16T12:57:00.604 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49626.log 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48093.log: /var/log/ceph/ceph-client.admin.44781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53193.log 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49626.log: 87.9% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49626.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52280.log 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48303.log 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose 88.9% -- /var/log/ceph/ceph-client.admin.43072.log -- replaced with /var/log/ceph/ceph-client.admin.53193.log.gz 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:00.605 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52280.log: /var/log/ceph/ceph-client.admin.48303.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52280.log.gz 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48303.log.gz 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.50400.log: -- replaced with /var/log/ceph/ceph-client.admin.43072.log.gz 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50274.log 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50358.log 2024-04-16T12:57:00.606 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50358.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50358.log.gz 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50274.log.gz 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49884.log: gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53153.log 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2024-04-16T12:57:00.607 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53153.log.gz 2024-04-16T12:57:00.608 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44655.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-04-16T12:57:00.608 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51330.log 2024-04-16T12:57:00.608 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52970.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2024-04-16T12:57:00.608 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51330.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51330.log.gz 2024-04-16T12:57:00.608 INFO:teuthology.orchestra.run.smithi018.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T12:57:00.609 INFO:teuthology.orchestra.run.smithi104.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T12:57:00.609 INFO:teuthology.orchestra.run.smithi104.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T12:57:00.636 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T12:57:01.093 INFO:teuthology.orchestra.run.smithi104.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T12:57:01.103 INFO:teuthology.orchestra.run.smithi104.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T12:57:01.105 INFO:teuthology.orchestra.run.smithi104.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T12:57:01.131 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T12:57:01.164 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T12:57:01.164 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T12:57:01.171 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T12:57:01.173 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-16T12:57:01.173 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.704s 2024-04-16T12:57:01.173 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m2.744s 2024-04-16T12:57:01.173 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.126s 2024-04-16T12:57:01.208 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T12:57:01.210 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-16T12:57:01.210 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m0.774s 2024-04-16T12:57:01.211 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m2.873s 2024-04-16T12:57:01.211 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.243s 2024-04-16T12:57:01.211 INFO:tasks.ceph:Archiving logs... 2024-04-16T12:57:01.211 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi018/log 2024-04-16T12:57:01.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T12:57:01.837 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi104/log 2024-04-16T12:57:01.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T12:57:02.259 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T12:57:02.271 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T12:57:02.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T12:57:02.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T12:57:02.353 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T12:57:02.362 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T12:57:02.362 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:57:02.365 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T12:57:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:57:02.380 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +472us[ +488us] +/- 54ms 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -760us[ -745us] +/- 61ms 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +351us[ +366us] +/- 87ms 2024-04-16T12:57:02.382 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +454us[ +463us] +/- 54ms 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -772us[ -772us] +/- 61ms 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +350us[ +350us] +/- 87ms 2024-04-16T12:57:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T12:57:02.385 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T12:57:02.394 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T12:57:02.395 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T12:57:02.404 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T12:57:02.498 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T12:57:02.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:57:02.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:02.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:57:02.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:02.631 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T12:57:02.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T12:57:02.650 INFO:teuthology.task.internal:Duration was 562.848947 seconds 2024-04-16T12:57:02.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T12:57:02.660 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T12:57:02.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T12:57:02.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T12:57:02.705 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:57:02.716 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:57:03.100 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T12:57:03.100 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-04-16T12:57:03.101 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T12:57:03.161 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-04-16T12:57:03.161 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T12:57:03.184 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T12:57:03.185 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T12:57:03.204 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T12:57:03.254 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T12:57:03.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:57:03.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:57:03.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T12:57:03.414 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T12:57:03.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T12:57:03.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T12:57:03.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T12:57:03.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:57:03.486 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:57:03.510 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-04-16T12:57:03.537 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-04-16T12:57:03.558 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:57:03.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:03.582 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:57:03.613 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi104.front.sepia.ceph.com, flagging run as failed 2024-04-16T12:57:03.613 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T12:57:03.625 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T12:57:03.625 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi018 2024-04-16T12:57:03.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T12:57:03.663 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi104 2024-04-16T12:57:03.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T12:57:11.817 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T12:57:11.830 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129/remote/smithi104/coredump/1713272184.44547.core.gz: gzip compressed data, was "1713272184.44547.core", last modified: Tue Apr 16 12:57:03 2024, max compression, original size modulo 2^32 268005376 2024-04-16T12:57:11.831 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T12:57:12.905 INFO:teuthology.task.internal: core looks like: /tmp/tmpfalgspxf: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T12:57:12.933 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i b 2024-04-16T12:57:12.934 DEBUG:teuthology.orchestra.run.smithi104:> which 'ceph-mds -f --cluster ceph -i b' 2024-04-16T12:57:12.953 INFO:teuthology.orchestra.run.smithi104.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T12:57:12.954 INFO:teuthology.orchestra.run.smithi104.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T12:57:12.954 INFO:teuthology.orchestra.run.smithi104.stderr:/usr/bin/which: no b in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T12:57:12.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:12.955 INFO:teuthology.orchestra.run.smithi104.stdout:/usr/bin/ceph-mds 2024-04-16T12:57:12.955 INFO:teuthology.orchestra.run.smithi104.stdout:/usr/bin/ceph 2024-04-16T12:57:12.956 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: "which 'ceph-mds -f --cluster ceph -i b'" 2024-04-16T12:57:12.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T12:57:12.981 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T12:57:12.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T12:57:12.991 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T12:57:12.992 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T12:57:12.998 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T12:57:13.014 INFO:teuthology.orchestra.run.smithi018.stdout: 266033 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest 2024-04-16T12:57:13.014 INFO:teuthology.orchestra.run.smithi018.stdout: 266034 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 266047 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 265389 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 265390 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:47 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 265391 192 -rw-r--r-- 1 ubuntu ubuntu 192738 Apr 16 12:57 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 406358 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive/audit 2024-04-16T12:57:13.015 INFO:teuthology.orchestra.run.smithi018.stdout: 406360 144 -rw------- 1 ubuntu ubuntu 147375 Apr 16 12:57 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T12:57:13.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:57:13.016 INFO:teuthology.orchestra.run.smithi018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T12:57:13.017 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: "which 'ceph-mds -f --cluster ceph -i b'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi018 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T12:57:13.028 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T12:57:13.051 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T12:57:13.094 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi104 with status 1: "which 'ceph-mds -f --cluster ceph -i b'" 2024-04-16T12:57:13.094 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T12:57:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: 265317 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest 2024-04-16T12:57:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: 265360 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive 2024-04-16T12:57:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: 265518 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:57:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: 265411 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 265424 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:47 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 265425 184 -rw-r--r-- 1 ubuntu ubuntu 186542 Apr 16 12:57 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 395023 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:57 /home/ubuntu/cephtest/archive/audit 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 395306 128 -rw------- 1 ubuntu ubuntu 127678 Apr 16 12:57 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 265395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 12:56 /home/ubuntu/cephtest/archive/coredump 2024-04-16T12:57:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: 265446 20108 -rw------- 1 root root 268005376 Apr 16 12:56 /home/ubuntu/cephtest/archive/coredump/1713272184.44547.core 2024-04-16T12:57:13.104 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T12:57:13.124 DEBUG:teuthology.nuke:shortname: smithi018 2024-04-16T12:57:13.125 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:57:13.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:41.088616', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMEVUKDqZzMfUSudXchvN2uYeGidekfIFWKsXHu/gZLhfwu8TUbiUkyD0uhXn/7Cg0L0ImEityTn4xHbacMWAo='} 2024-04-16T12:57:13.151 DEBUG:teuthology.nuke:shortname: smithi104 2024-04-16T12:57:13.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:57:13.175 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:41.087254', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJx6p853EcotvH90NVoZD9xtnANTx3LRiJtJMb924TOc8C3Sl4x/u8/L59YbBM/3i8CQ3PwcphraGV8X+DY+2Kc='} 2024-04-16T12:57:13.194 INFO:teuthology.orchestra.console.smithi018:Power off 2024-04-16T12:57:13.195 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T12:57:13.223 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-04-16T12:57:13.224 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:13.243 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-16T12:57:13.243 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T12:57:13.256 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-04-16T12:57:13.270 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-16T12:57:13.270 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:13.294 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-16T12:57:17.257 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:17.296 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:17.369 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-04-16T12:57:17.406 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-16T12:57:21.372 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:21.407 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:21.483 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-04-16T12:57:21.519 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-16T12:57:21.584 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-04-16T12:57:25.520 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T12:57:25.631 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-16T12:57:25.732 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-16T12:57:25.837 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/recovery-fs} duration: 562.8489470481873 failure_reason: 'Test failure: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f25dfd322a6143c39e1c3f53df392871 status: fail success: false 2024-04-16T12:57:25.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T12:57:25.911 INFO:teuthology.run:FAIL